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FOR£'./ORD 



the title of this work, An <ntroduction to Advertising Research , 
should provide clues to the author's intentions regarding 5ts purpose 
and its intended audiences. 

' • • • 

^t,s purpose is tcr present in p'la?n non-technical language most * 

of the basic concepts of advertising research. *lt is intended to be 

readable and comprehensible to the intelligent layman unversed in 

/ > - ' • ■ • . 

either/the field of advertising or the intricacies of research 

methodology-. In that light, it cannot go too deeply into the 

technical details of advertisrng or .research methodology. ■ Hov;ever, 

used as an .introduction and outline to be supplemented by outside 

readings (to be cited in subsequent drafts) j. it can be useful as a 

gu-ide to greater mastery of advertising research practices.^ 

If it is indeed "comprehensible to ,the intelligent layman," then 

perhaps i't w5 11 be useful to these kinds of audiences: 

— Advertising practitioners and'^dec i s ion-makers with no great 
baclTground in research methods who wish to become discerning consumers 
and users of research, wi thout becoming enmeshed in technical detaU^. 

--^ki 1 led Vesearcliers from outside' the advertising field who wish 
to learn -some- of the applicatfons of research to advertising as well as 
the' technical variations^ in technique and method that are unique- to the 
advertising field.'- ■ 

--Students of advertising and market ing., who v;ish to have an over- 
view of the role of research in the total advertising process in order 
to become discerning consumers and users in the future. At the unc'er- 
graduate level, additional readings of moderate complexity should be 
recoiiuuendcd. 'At the graduate level or as an advanced.. advert i s i ng 
\ research text read i ngs of a. more technical nature should be provided. 

--J3H, March 1S7^> 
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CHAPTER I . THE ADVgP.Ti Si :JG PROCESS 

Advertising is most simply defined as an attempt to persuade some 
people to purchase a product or service by means of messages through paid . 

media. ■ . ^ 

The first step, toward an understanding of advertisi'ng research is to 
acquire some understanding of the process by which advertising decisions 
are made. Research is a tooN that can help make wise advertising deci- > 
sions. ' ^ 

•An advertiser may*approach the task of advertising either unsyste- 

* ' -.' ' 

matically or systematically. . 

i . 

" ■ ^' ^ • ^ ' 

Unsystematic Process ^ 

Th^ unsystematic approach--st i 11 followed by many^ com.pan i es and ^ 
•advertising agencies to a surpr^i s i rjg .extent— i nvol ves decisions based 
mostly on personal preferences, tradi'tit^, emotional Yeactions or simply 
convenience. The most obvious example of the unsystematic approach is the 
company president who a.dverti ses only in those magazines which he.and his 
family andjriends like to read, whose advertisfng expenditure i s ^ased 
on the amount of money left over after other company activities have been 
taken care pf, where advert'isement;s' are ' based on his personal ^'gut. reac- . 

tion,'' who insists that his advertising coTitain boring accounts-^f com- 

0 ■ 

pany history or his own business* philosophy. This approach may be 

r 

personally very, sat i sfyi ng to the sponsor, but it',s unlikely to produce 
very many sa?es fof his product. The end result may range from, at ^st, 
simply a was-te of the money spent on advertising, to, at worst, a negative 
effect which alienates the public.and produces .fewer sales than if he 



hadn't advertised at all. And there are documented cases where advertising 
has had, not just a neutral effect, but a strong negative effect. ■ 

Systenatic Process--The Four M's 

A systeiTiatic approach to advert i s i ng, on the other hand, v;ould be^to 
pose a series of questions to which objective answers would be sought, 
questions such as the following: , 

What is the market for my product? 

* Which med i.g are .T^ost efficient in reaching those people? 

Which messages are most effective in persuadi ng • those people to choose 
my product? 

How much Hjoney miTst I spend'on advertising in order to reach the right 
people through the\ right media with the right messages? 

The first quest ion--defi ning the market'-is usually a job for marketing 

research in the pre-advert i s i ng stage of product development and deciding on 

marketin^g goals. Once the market has been defined, ^however, it is the job 

of advertising research to answer the'^quest ions about med ia , messeges and 
1^ ^ ■ ' ' < » 

money. 

Thus, the three main subdivisions within the broad field of advertising 
research arve media research, message or "copy'* research, and expenditure or 
*'money" research. ' " . 

\ ■ ■ 

Def i ni t ions . , These are the four M's of the advertising game — Markets, 
Media^ Messages and Money. Sofne standard advertising definitions for those 
terms will be used here. The. market consists of the people who are the 
intended prospective purchasers of"a product. The media are the channels 
of n»ass communication used in advertising,, the major ones being newspapers-. 




specific representative of a rriedium; the"^*ew York i ines is a aewspaper 
vehicle, the Readers Digest is a magazine vehicle, KDKA is a r^dio vehicle, 
and so on . ' . " 

A message is any individual advertisement intended for placenient in a 
r.e^dia vehicle. A campaign is a systematic series of messages- 

*- • 

• Stages of the Advertising Process j.> 

The systematic approach to advertising may be further clarified by 
the fol lowi ng model of the advertising process, describing the stages that 
an advertisement must go through in order to reach its target and have .the 
desired effect. ^ ^ 

After a product and its market have been defined, any advertisement 
placed in any media vehicle must p^ss through a six-stage obstacle course 
in-order to be successful (ARF, 1961): ' " . 

- vehicle distribution , ' 

- vehicle exposure • 
' - advertisement exposure , ' 

- advertisement perception * • 

- advertisement coriimuni ca t i on . y 

- behavioral response. 

In summary, successf u 1 ^advert i si ng ^i nyol ves a chosen media vehicle :^ 

v%/hich is distributed and exposed to the/product As , gotefnt i a 1 customers, in 

^v^/hich the advertisement is exposed,- is percciil7ed and communicates the 

intended meaning, culminating in one or more behavioral responses including 

fDurchase o*f the. product. ^ ^' 

[ \ '^- \ ^ , 

This* leads us to a s,omev%/ha t ' more pnt^Cjise definition of two -major j 

kinds oT advert i sing research. 

. . 12 * 



Med i a .. res ea^'ch is concerned with measuring the effectiveness cf media 
* . vohiclcs which are responsible foe the fi s of the 

advertising process: vehicle distribul i sure, and 

advertisement exposure. 
Me;3sa 9e^ or copy / resea rch is concerned w^th measuring the effective- 
. ness of advnrf i sements which are responsible for advertisement 
perception and communication. 
This breakdown clarifies what the media vehicle Is supposed to do for 
the advertiser, and what the advertis.ing message is supposed to do.- Their 
functions are to a large extent independent of each other, and can be con- 
sidered and researched separately. To summarize: advertisers generally 
assume that the advertising vehicle'is respons ibl e ^for vehicle distribution, 
vehicle exposure, and advertisement exposure; the advertising message is 
responsible for advert isement; percept Ion and communication, 'r^ 

Veh icle distribut I on . This, refers simply to the number of physical 
units of a give^n vehicle through whi_ch an .advert i sement can be del I vered . 
"Ci rcul at iori^' is thq usual term applied to number of units of vehicle dis- 
tribution. \ 

I ^- . 

In the case oft a particular magazine vehicle like the Readers Digest , 

' . ' - . . ' ^ 

circulation is the number 'of copies ofta particular issue (or the average 

\ ■ , • . ' '■ 

number per issue) that are delivered to. subscribers and other receivers. 
Notice that circulation is not equ i val ent to the numbo-r of copies printed, 
since many of the printed .copies may not be distributed and 'del i vered.. 

In the case of television, vehicle distribution refers to the number 
of sets tuned i'n to a particular vehicle or program., Take a local TV - 



• . 5 ■■ 

station's 6 P.M. news shov/, for exampl-e: i ts .-di str i button is not tine 
number of TV sets in a station's coverage area, nor even -the number of sets 
turned on, but the number of sets tuned in to the 6 P.M. new nrogram 

(or some averaqe number for that program) . 

■ ■ V 

In the case of o'^utdoor advertising, d i s t r i but i on wou 1 d correspond to 
,the number of posters carrying the advertising message, 

A measure of vehicle distribution is the very roughest measure of a 
vehicie^s value in disseminating advertising. It specifies only the num- 
ber of inanimate physical units in which the message is carried, but says 
nothing about the number of people exposed or affected in other ways. 
However, distribution of the vehicle is a necessary condition for the 
advertising to have any effect, and in -the absence of more precise data-- 
as is sometimes the case--it provides one. rough numerical basis for com- 
paring one vehicle with another. 

Now let's consider the next stage in an advertisement's journey if it 
is to have any effect^ vehicle exposure. 

Vehicle exposure. A magazine copy delivered to a home may be read by 
-several persons, or one person, or by no one. Similarly, a TV set tuned 
to' a particular, program may have no viewers in the same room, or it may ,, 
have several. Obviously, someone must be exposed to a vehicle unit for it. 
to have any value to the advertiser, which explains why vehicle exposure • ^ 
is a better measure of ef feet i veness than vehicle distribution^ 

\he primary measure of vehicle exposure is the number of people exposed 
to the vehicle at least once. The people exposed make up the vehicTe|s 
"audience," regardless of whether we're talk^g about newspaper, magazine, 
TV,"^faclio or any other medium. 14 



It*s apparent that a vehicle's audience size cr.n be quite different 
^rom it's circulation size. It*'? possible for audience size to be less' 
than circulation- in the case of some vehicles — where there is less than 
one reader per average magazine copy, or wher^ ' large number of tuil^d In 
[V sets have. no one in the same room. U= .1, ver, audience size is 

icroc'.r than circulation, and media vehicle^ ^ compared on the basi| 

of audience size. 

It's not hard to think of examples where two or more vehicles with 
the same circulation may be quite different in audience size. A^woman's 
mogozine may have only one reajder per copy, while a general family-appeal 
manazine may have th,ree or^more readers per copy. 

Ab noted earlier, aqdie'nce size is a more useful measurement than 
circukition. it; is at the same time, however, more difficult to define 
and m>jaGure, and a great deal of media research is aimed at clarifying 
precisely what is meant by exposure in terms that will permit comparisons 
between different vehicles.^ 

In general , a vehicle exposure is a person- wi t.hi n siqht^or sound of a 
^ di St r t julgd vehicle unit . But to be a usefu 1 measurement , it's necessary 
to be more precise. . ' . ^ 

. Consider a speci f 1 c magaz i ne copy — let's ^ay'the latest issue of 
ReadfM • s Pi ges t . Which 6f the following is an '^exposure'" : 

— a person who has from a distance seen it lying on a table? 

- a person who has glanced idly at the cover? 

" a person who has picked up a copy whi le' going' through a' stack 
of magaz i nes? • ' ^ . ♦ 

- a person who has riffled through the pages but hasn't read 

/ anything? . ^ " ' 

" a person who has read at least .one i tem completely? 

" a person who has spent at least five minutes with the 

«• ♦ magazine in 'his handsVo . 

^ - a person who can correctly identify something from it? 
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Or'cbnsider a specific instalment of a ^tel evi s ion progranir- let* s say 
• la^st night's instalment of the 6:30 P.M. N,BC news. Assuming that the TV 
set! Is" oh and tuned to the NBC channel, which of the following is an 
exposure: * . . 

- a person, who hears sn . of it from another r^' i while doing 
< . sbmeth i nn 

- a person wli Lii* j.i the. room? ^ 

- a person who is in the room but talking all through the ^ 

p rogram? - ' 

- a person seated in' front of the set throughout but who is 
. ■ ' read i ng, a/feook? 

r ^ person who watches and listens to the program for one second? 
one minute? five minutes?' 

- a person who can remember, unaided, at least one item from 

program? 

Or consider a poster. Which of the following Is an exposure: 

- a person v/al.king or driving by in e i ther d i rect ion? 

* . - a person walking or driving by in a direction facing ihe 

advertisement? 

- a person driving by i^M-th his eyes on the traffic? 

- a person whosu. eyes happen to g'nnce at the billtipar 

- a person. who is able to recall v/hat was on the billho:. ? 

These "may seem lik: trivial questions until a media buyer i .~ id 
with the problem of* dec; ding which of three-vehicles is best for advert is- 
ing a product — a magazine which claims for the average issue 20,000,000 
exposures (meaning the number of people whQ have held it in their hands), 
a television program wi^ich claims for the. average ' even i ng 20,000,000 
exposures (meaning the niaiber of people who have been in the same room at 
^^least five minutus) , , poster assembjage ^.^hich claims 20,000,C >0 expo- \ 
sures iiiy L/.o Mu« /»oi of people whovvalk or drive by in the average 

_n?v/i I L h ) • , • " . « 

^ One job of media research Is to decide which measure of vehicle expo- • 

■ • • c 

sure is mos*t v^^lid for each media type. Another, and even knottier, is 
to determine how to measure it. ^ 

16 . 



Then, assuming an«.exposure to a magazine can be defined and measured 
and that the same caH?b'e done for a television program, how can the buyer 
be sure that one exposure in 'a magazine has the same value as an exposure 
in televis ion? . * 

So far, vehi cl e exposure has been described as the total number of 
pC'.Oi;>le exposed to a Vehicle unit.. Another in^j^^rtant factor^is the number' 
of exposures per persons-two exposures by the same person are probably more 
valuable than only one. Different vehjcles- may have the same audience 
size but d i ffer great 1 y' on number of exposures. if magazine A has 
20,000,000 exposures (10 million people exposed twice each) and magazine B 
has 20,000,000 exposures (20 mi' ion pooff^le each exposed once) , are they of 
equal value to the advertiser? 

Vehicle exposure; then, can r-^'-r both to the number of peopl.. who 
are exposed (audience size), and thuj tr.tai number of exposures, which is 
audience size multiplied by the ^iV-'crac. number of exposures per person. 

Note that nothing has yet t .1 about the number of people exposed 

to the advertisement itself, v;hic mny be something quite di^fferent from 
fhe number- exposed to the vehicle . This takes us to thf. »rext stcoe of 
media evaluation and comparison-- Ivcrffsement exposure^ 

.■ , ; _ V • _ 

Advertisement exposure . Th . roan- exposure to a specific ac ertise-. 
ment in a specific vehicle unit. "Number of advert i sement exposures" is a 
more exact measure of advertising effr ^veness than "number of vehicl e 
exposures"; it eliminates those" pe:'::-^\^ who were exposed to the vehicle 
but. not to the advertisement. Veh. l. xposure sets an upper limit to 
advertisement exposure.' ^ 

The general definition of a: aav -^tlsemant exposure Is "one person 



within sight of sound of the p a rticular advertisement in question . ' ' 
^Advertisement exposure, can be specified in terms of the number of people 

exposed, or the total number of exposures, just as in the case of Vehicle 

exposure. The problems of definition in precise measurable terms are even 
\mdre difficult than for vehicle exposure. How can the researcher determine 

whether a person saw a particular magazjne advert i sement > and^ i f so whether 

he saw it in the particular vehicle under evaluation or somewhere else? 

Or, assuming a person recalls seeing a particular TV commercial, how can - 

the researcher determine where and when he- s*aw it? 

Measures of advertisement exposure provide the rjiost direct index to 
. describe hovi well a media vehicle conf^ronts people ;y/i,th an- advert is i ng 

message, but says nothing about the quality or effects of the message 

itself. 

In fact, advertisement exposure is a function -of how well a vehicle 
delivers an audience to a space 'that can be occupied by any advertisement, 
without considering the quality of the message i tsel f. Looked at in this 
way, it might be more precisely defined as '*the opportunity for advertis- 
ing perception to take place^* and has been called advertisement; space 

exposure. ^ - 0 

" ' • .. ■ ■ - ^ 

Advertisement percepti^. One is on fairly firm ground in talking- 
about vehicle distribution; vehicl<=» exposure, dnd advertisement exposure; 
they are relatively easy to describe, define, and count. ; Advertisement 
perdfeption, hov/ever, is an entirely different kirrd of measurement, since 
" it deals v/ith a person's respons^e to a 'message'. 

s 

Perception is defined as conscious awareness of obj ects or other data^ 

.-■ • ' ■' : ^ . t8 [ ■ • / ■ \ 



through the sienses ; in this particular case, perception means awareness pf 
or attention to an advertisement, - 

•Advertisement exposure can be df^t i ngu i shed from' advert i sement percep- 
t ion by the following diagram: 



Tel evi s ion 



Magazine 



Advert i sement 
Exposure 



Advert i sement 
gercept ion 



a person in the same room ], a person who is aware of 

with a TV set turned on^ j the sound or picture or 

but -who doesn't hear or ^ both frpm a TV commercial, 

see a commercial when i't <j even though he may deli be r~ 

.comes on because of day- • ately try to screen it out,' 

dreaming, conversation, i as in the case of some 

other activity; ^tc, |. annoying commercials- 



a person- idly flippirfg" ; , ; 

through the pages of a j a person flipping through 
magazine while thinking | the pages of a magazine who 
of s^omething else but who j sees or reads a part of the 
doesn't see the advertise-; advertisement, 
ment even though it passed;: 
in front of his eyeS, !: ' 

1 : 



A person exposed to a newspaper page provides>^ari ijiterestirig example 
of the distinction be|:vveen exposure and perception. Eye-movement cameras 
have been used to photograph all -the places on a newspaper page oyer which 
a person's vision has wandered. Previous tests show that -a person s gaze 
will generality pass over or "scan" almost every item on the page, no'mat- 
ter how small, .When asked to go back over the same page with an inter- 
viewer and point out what he has seen , however, the person* can peport see- 
ing only a. fraction of rhose i tems ; som^of them he *is not at all aware of 
having seen. In this case, exposure has occurred on all those items over 
which his gaze passed: perception has occurred only on tnose items which 



19 



he is at lleast^aware of;ji^ving seen, One magazin^ stuJy found that about 

two out of three expo/ures result in measurable perception. 

•'Aided ^recal 1" 3nd "recogni tion" scores of ads are measures of per- , 

ception commonly used by ^ the' pr i,nt media, 
a 

In practice^ there is a very ^fine line betv/een ex; ,i.u i ion 

ur ihe one hand, and.betv. ^ perception and .commun icat ion on the other and 
this poses problems of rreasurement which have not been-* a 1 together resolved. 
Perception is, neverthels ess , important to the advertiseV because it can \^ 

prcvide him with a basic measure of the effect of hi,s advert i sement— i f he 

. ■ \ ■ . ■ ' 

can def.iae it and if he can meas^^n-e^i t . 

In addition to simple awareness of an advertisement's existence, 
advertisement perception includes othe- effects such as interest in, , 
recall ye/r recognition of, knowledge of and attitude toward the ' advert i se- 
ment (as distinguished from product or bread awareness, interest, knowl- 
edge and attitude, which may be ponsidere: functions of advert isement com-, 
munications) . 

-Thus, one distinction between, perception and communi cat i on i s" that 
the former .refers to acvert i sement responses and the latter refers to 
^ product ' responses . " - . . ^ ■ . 

Advertisement cornmuni cation .. I f an advertisement adds to someone s 
product knowledge, or affects his product attitu'dc, or stimulates a desire 
to take some sort of product action, then it has communicated to him. Con 
versely , i f so:neone repofe- seeing an advertisement, but there is no 
evidence of increased prociuct knowledge or 'attitude change or action- 
arousal, then it has been perceived but has not communicated. 

2C 
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.In the field of psychology., these three kinds of effects are labelled 
as "cognitive" for knowledge, "affrctive" fox attitude, and "conative" 
action-arousal. There are varying degrees f r i; tiuti 'tion within each 
i in Oh^ (''■^""ly, several different measures may be necessary vo determine 
the kind and degree of communication that has occurred. "Awa re "^nss" or 
"Swlienc-r:" IS one such measure in the cognitive category. 

".^-^^Didec recall" of some aspect of an advertisement is another; this 

) 

means t it something from the advert i sement can 'be remembered, that one or 
more pai ricular elements of the advertisement had an' impact on. the mermry^ 
cells. 

It has been demons t r-r^ted , however, that awareness and factual recall 
do not- necessari ly result in a change of attitude. Consequently, varrous 
measures of attitudes toward a product have been devised and used to get 
at this importan tT<i nd of commun i ca t ion . ' At ti tude genera 1 1 y refers to the 
overall liking or disliking for a product, the global reaction to the. whole 
product along a favorable-to-unfavoVable continuum. But when one speaks of 
the feeling about so.Tie spec i f i c aspect, trait or attribute of a product 
rather- than the whole product > this is referred to as the "product imqge." 
In. the case of a caV, some of i ts attributes are power, attractiveness, 
economy , durabi 1 i ty, comfort, ease of maintenance, and so on. An advertise 
menr Tiay change some aspect of the prpduct image without necessarily chang- 
ing the overall attitude — for example, if an automoWle advertisement 
str;:e ses horsepower, the reader may become more convinced that the ca is 
pov.'erful, but if increased power is unimportant to him his attitude w-ill 
not c io"ge. (A subsequent section on attitude rciasurement deals with this 
in •nr'^re de'ta 11.) ^ 
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■Even though product knu. ' .'J product attij^der- as llvj 

result of an advertisement, this ms^ no, be sufficient to produce "action- 
arousal"--a strong motivation or desire to take some sort of action regard- 
ing the product. In the case of a car', action-arousal could. tak6 the form 
of a desire to visit the dealer's showroom, or a desire to take a ride or . 
drive in the car, or a strong intention ^o purchase that car. 

Note^that action-arousal is not the same as the action itself--on1y 
the desire to take action. it is considered a somewhat stronger advertis- 
ing effect than 'attitude change j because attitude change does not neces- 
sarily result, in the desire tb take action. i t ' s c^ons i dered weaker than 
behavior, .since other things may intervene to prevent the action, or 
behavior, i tsel f from taking place even though arousal (desire, conation, 
motivation) may be present. 

Iij^summary , then, successful communication may be measured by an - 
increased awareness of or knowledge about a . product, or by a change of 
attitude dr-image, or in a desire to take some sort of action regarding 
the product, or in some combination of those responses. There Ms much 
, disagreement among advertising researchers as to. which of these is the . 
best measure of advertising communication. it is probably- safest to say 
that they all measure some aspect of communication effectiveness, that it 
is not yet 'known which one is most important or if they ' re equal 1 y impor-^ 
tant. Logic indicates that attitude change or action-arousal are probably 
closest to the ultimate criterion, purchasing the product. 

IBehsvioral respon se. A behavioral response to advertising can take 
•many forms, since it refers to any.sort of observable behavior resulting 
therefrom. The ultimate and most -des i rable behavior is purchase of the 
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product. There are various intermediate forms of behavior which may be 
necessary and/or' des i rable--ta 1 ki ng about the product, visiting, a retail 
outlet to* see or couch the p roduct , bo rrowi ng or otherwise trying the 
product ,vand so on. But our concern here is with the ultimate response, 
a purchase. t . ^ 

The purchase response has two important advantages over such psycho- 

'a. 

logical responses as perception and communication. The first is that it. 
measures exactly the effect advertising wants to achieve. One might 
quarrel v;ith the notion that an advertisement nee'ds to communicate product 
facts which ^stick in the consumer's memory, but no. one can deny that a 
purchase of the product is desirable. The second advantage, especially to 
the advert is i ng 'researcher , is that purchase behavior is often easier to 
measure. Behavior is something that can be seen, pointed at and CQunted, 
whereas perception and communication cannot be observed insj de the con- 
sumer's mind and rrust generally be assumed on the basi^of what he says 
was perceived or commun-i cated . * 

One di f f i cul tty V : th using purchase response as a measure of adver- 
tising effectiveness, however, is that it is hard to di s-entangle, the effect 
Ckf advertising from the numerous other factors -whi ch influence purchase. 

Take 'a single act of purchas i ng-- i t . i s' the resultant of such things 
as product qual ity, previous experience witti the product , ava i 1 ab i 1 i ty of 
a retail outlet, the possession of enough money o.r credit, the absence of 
deterr'ing factors such as ^ veto by another family member or a^cut-rat'e 
campaign by a competitive p-'oduct. It's easy to see that' a purchase can 
take. place without advertis ^g, or even despite poor advertising (which 
is worse than none;; coiwen-ly, despite the best'bf advertising, the . 
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overridin.9 influence of other factors may prevent a said from taking place 
' VThis illustrates the 'di ff icul ty of separating the influence of adver- 
tising'from all the other inf 1 uences "fen sales. 
^ There is one way in which advertising's behavioral effects can, how- 
ever, be isolc-:ted, any that is through controlled field experiments; these 
'will be treated in more 'deta^^^i.n a later section. Suffice it to say at 
t\)\s point that the controlled field experiment is the only completq^^y 
acceptable method which can separate the effects of advertising from all . 
the* other influences on sales. 

"Su mmary of the Advertising Process ^ 

* This chapter has dealt In some detail with various st^es in the 

advertising process.- While not -dealing with advertising research pei^se, 

*this model -the way advertising spreads and influences can be yseftl in 

.distinguishing the various functions with which research must deal; it 

sets »the stage for the succeeding chalDters on various phases of research. 

' A systemat i'c approach to effective advertising demands... 

...that a product's market, or potential customers, be 

definea and described, . 
'...that advertising media^which are efficient in ^ 
reaching the product's market be found, 
• ...that these media vehicles be distributed to the 
market^ 

* ...that the vehicles must be exposed to those persons, 
...that the advertising within the vehicle be exp bsed , 
...that the advert i s i ng be perceived , 
...that some form of commun i cation take place, 

after which , ^ 
...the goal of a sale may be 



on sales are not overr 



reached if other influences 
"l^ing. ; 

Vehicle d i s t r i but ion , veh i c 1 e exposure" andT advert is i ng exposure are 



generally considered to be the responsibility of the media vehicle in 



■ . • i 

v;hich the advertising i-s carried.^ The evaluation and cbmparisonv^of media 
vehicles f a 1 1 s- wi ch i^n that category of arivert i s i ng research cal led media 
research. ' - ^ 

7 — ^ . ' ' ^ 

Advertisement perception and communication .a^ro- generally considered 

to be , the responsibility of tlie advertising .nessage . The evaluation and 

testing of advertisements is another category of advertising^ research 

^railed message, or copy, research r ' . 

/ vehicle distribution, "vehicle exposure and advert Ising. exposure', are 

•relatively easy to define and less susceptible to verbal distortfon, but 

they represent only intermediate steps toward the adverMs/ir's ultimate 

purpose, ^ ^ • ' • 

Advertising perception and communication are -dif f icul t. to define and 
not amenable to di rect measurement , since generally one^must rely-on the 
'consumer ' s verba 1 report, which may or may not be accurate. 

Of all the possible responses to advertising, a purchase^has- i!he most 

/ »■ ^ ^ 

to recommend It A purchase is amenable to d i rect^measu'rement by the 

\ 

researcher without reliance on verbal reports . It is indisputably relevant 
to the main purpose of the adve^tiser. The principal drawback to adver- 
tising researchers lies in the heavy influence of non-advertising factors. 
This difficulty can be surmoynted through the use of rigorous re.^eBVch 
methods, principally through the controlled field experiment;' However, a 

.single advertisement is usually not a suff i cient -amount of communication 
to bring about a sale, except in special cases; therefore the sales effects 
of advertising can usually be detailed only for campaigns and not for 7 

* individual advert i seiiients . 



CHAPTER II. -THE RESEARCH pROCE^S"^;' ^' - V- 

■ ■ ■ ■ , ^ ■ ■■ ;i- ■ ■ : , 

Just as there -fs an 'advert i s i ng process, an orderl y^'model of-^how - 
advertising work's, so cfiere is a, research process . /Thi s^process involves . 

both a scicrttific oppro^ch t6^ pr6bl^ni-sol vi nq and an orderly pVOcedur^ of 

^ . " \. . ' ' - ' . 

steps to be followed in planning and executing- a research prdjcct. 

- ■ / : \ ^ - • ■ , ' ' - ' - 

The Scien ti fic Approach to Advertising Prol^ rcmg; . 

The creation of advert i s i n^^J^s the res^\tan^t of , two kinds of 

thinking--the, business approach and tl^e creative approach. .These 

approaches are usually housed in twoy d i f fcrcnt kinds. of people cfibond in 
*> . - 

advertising-7,the business mind and the creative mindj, only rarely found in 
the same person. The business mind is concerned with marketing, the ^ 
practical and tangible aspqcts of running a Business, and making profits.^ 
The creative mind is primarily conccrnefJ with a rt i st i c , creative and 
intangible aspects of communication. For many years, advert i s i ng* has 
thrived through the combined effort^ of these two approaches. The, public 
image of the advertising e>^cut^'ive as a soph i^st i cated , persuasive, .dynamic 
glib ar.d business-like feUovi with a satchel fullof eye-catchi ng . ad lay- 
outs is really a composite .of the bus i nes^^-^-aT^^ approaches*. 

In rodent years, however, there has been a grovymg feeling among 
^advertisers--hard-headed*busi*nessmen themseUy^es — that another approach is 
needed to, round out their advej-tising efforts. As one businessman expt^es- 
sed it, "I know that half my advertising is wasted but I don.' t know which 
half.': In short, much advertising has been conducted wi th' no "feedback" 
fts effects--that is with. nS knowledge of the eventual effectiveness o 
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the effort, no underitandiog of the general principles of how and v;hy 
advertising succeeds or fails.^^no real evidence to demonstrate success or 
fai 1 ure . '1 ^ 

Such jadvert i s i ng is analogou^^'to a hunter with an expensive high- 
powered rifle, firing madly at a group of moving targets in the black of 
night, then moving on complacently without bothering to see i f jbe has 
actual I y h i t hi., "^orget , sa t i s f i ed s imp ly because he has been firing away . 

The missing ingredient . in advertis ing ^in many cases has been the 
scientific approach. Broadly, the scientific approach simply means an 
orderly, objective investigation to gather verifiable facts that will add 
to. knowl edge,'^' understand! ng and control over future activity* 

Like many other fields of social and behavioral study,' advertising is 
certainly not a science, but it is nevertheless possible to use ^ scien- 
tific approach. The scientific approach--whether it be. in chemistry, 

politics, psychology or advert i s i ng--has certain dist*inguishing character- 

<? . 

i sties: \ , 

The procedures are explicit . The results and the methods, for obtain- 
ing them are so clearly described that, another competent practitioner can 
read the research report and replicate the procedure if he wishes. The 
detailed description is minutely honest 'down to the finest detail of pro- 
ced^jre. ' - 

The dqta-col lectinq is objec^ti ve . Once a procedure has been formulated, 
and an investigation started, the researcher is low the data 

and report it objectively, whether or not it agrees wit s pre.onceived 
notion, of. the outcpme. The advertising researcher must fight against per- 
ceiving or using only the data which will "prove a point," either his ov;n 
or some one else's. Quite often, research will, come up with the opposite 
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answer than that predicted; t.his' apparent ly.- i I logical outcome must be 

perceived and reported according to the revealed evidence. 

The findings must be replicable . Other researchers , should they 

/attempt to verify on investigation's results, should arrive at the same 

conclusion. Intuition, artistio sensitivity, and clinical insight are not 
it ' 

sufficient to establish a p6'int of fact. - 

' The appro ach is systema tic and cumulati /e- The adverLising icc^orclK-r 
. in addition to investigation of an immediate problem, tries to build up 
whole bodies of knowledge, an organized system of verified facts, general- 
izations and principles, all -based on evTdente rather than his hopes or 
bel ief s. 

The eventual purposes are %planation, understanding and control . The 

. ^ .. 

advertising researcher wants to know why^and how something happencH, 'cj.tH i>o 
able to prove it. Then he can ^predict and bring about the conditions to 
achieve his objectives. His ^object! ve is'the creation of advertising that 
will sell the product better or more efficiently than any other advertising 

The researcher is both open-nn nded and skeptical . He is open-minded 
about accepting the possibility of alternatives to his own >et notions, or 
to the usual "corrmon sense" answers; in other .words , he looks critically at 
cherished assumptions, thinks of alternatives, and admits themto his , 
thinking as possibly correct. (The hardest alternative fo>...an advertising 
man to accept is that his advertising is no good ; the usual assumption is 
t:hat there are only two. kinds, gqod-and better.) At the same time, the 
researcher^ must be extremely skeptic il , r in tant ro irrcpt anything as 
.'fact until it is derronst rated . 

The sclent if i'^c approach to adve rt i s i ng- i s not ^merel y a hi gh-mi nded 
abstraction to be indulged only as a luxury. It is the only pr.ct'ical • 
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way to insure age. : advertising f: 
success. 



J improve the probability of 



Advertising Goals Their Depencer. \/ 



Let's introdu. here a technlcc ; 
about advertising research. The ter i 
simply means "the quantity that is rr.i 

■ In measuring e person's height 
is usually inches. *ln measuring v^eic 
pounds. !n measuring temperature, th\ 
degrees- f ah renhei t. Even in these simf 
variables that vje could use instead: 
instead of pounds; centigrade-degrees 
are equally correct, so we must alv/ay 
are used. 

Similarly, it is not adequate i ^ 
(or was not) effective." To be^ pre, , 
penden't variable involved must be s 



es 

"ch will be useful in talking, 
ndent variable," and it 

ole, the dependent vari^bile 
:epe ndent variable is usual ly 
ent variable is usual ly 

ses, there are other dependent 
instead of inches; kilograms 

J of fahrenhei t-degrees . All 
y which dependent variables 

state "Advertisement A was 
measure or criterion or de- 
Thus, one can ac^>dr^tely say 
att i tudes" or "in incf^easinq 



"Advertisement A was effective " in c 
consumer awareness" or " in Increasinc c :sumer knowledqe ." Effectiveness 
is always in terms of. some dependent variable which must be specified. 

The dependent variable used in measurement should always be directly 
related to the stated goals of the advertising^, \7here there aVe many adver 
tising goals, or v;here the researcher is uncertain as to which of several 
possible goals is the' proper one, he may include. many different dependent * 
variables in a surx^ y; this may inc^ ■ three 'dozen generaj and 

specific questions, each designed to i < a different dependent 

va r i ab 1 e . 
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In rnort, 
ef f - - : ness , a- 
dep- " '^nt variabU.: 

Sten^ in Planning 



•* : coal-settirg is a pre^equis'te to r ^ur^ng 
c)c 15 determine r-- ^ sures c effect ^ .mic.iis or 

1 investigetec tbr m research. 



1 Project 



The simplest r'lfn'.' on o;f research is "careful, systematic 



: I s i r 
^sc r 



to 



'study and inves 
facts or pr in : 
tion. 

Whether ac: 
ur -.ior study, th 
a s ,'Stemat i c sc 
fui i n formal i' 

Here i 5 r ' 
and executing 
enou nh to be :zj i 

1. n,::fi , 

2. ;vi- v.'^- 

3. :-ci:, v/i 
A. Cc- i:c-t t 

5. Anal-' 

6. intei* 

Th i s may i^eem kc 
e:: of these steps, 
c "eat ainoi m t < ' ~ 'i'^ 
t _ steps in det ' 



some flpld of kncvledge, unriertaken t 
is not a hap^^a2a^ nasty collection 



t i ent 
?STab 1 i 
fc-ma- 



ir cherrtistry or history or any other s ject is 
process can be outlined as an orderly orocecure, 
eps which should be followed to get the most use- 

of the steps that should be followed in planning 
Jng research project. Thi s out 1 i ne m"s bread *. i 

y advertising problem, 
probl en " ' 
t is known about the problem ("Secondary" research) 
the research method? to be useid C'Primary" research) 
2 research 
e data 

md report the results 
very precise prescrintion for action. Within 
e.r, a number of decisions must be made, and a 
^DMninri is i\ecr-^<^r ■ ■ . Let's look each of 
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De^^ ne the prob lerr . ~* n:. cla fication ' probi ^ end 

up v/ith one or more spe::ific :i: ' :ns t can be ans ;ered emp i r iy. 
This step is frequently glossed ^ huf ed!y, bjt Ir is e^itreme i~-:,:r- 
tant; tne more time spert discus^ ' anv clarifying £ problem frc~ nur- 
her of different viewpoints, the c *e u.^ ful v;ill be zhe eventual r-?:-, its. 

VJho.is the^ person reques . ' ^ In rmation? v'ho will 'use cnce 
it IS produced? What dec's'ic r sed on -he "^esults? 

A c ;cd way to start the : l,ir ficatibr nrccess is to 

*'\rihat are the objectives of "t ^ly^.^. g?" The c ertising c; ja s — 

stated in terms of markets, pT0$O::c:^s intended eff — mus: stated 

explicitly before the researcner rar" to;: to measure V results 

Generally, a problerr, cor:5 to . ' searcher r^orr :. :jone else con- 
cerned with making advertising d'- J either fr^om th^.: businc:-s de or 
the creative sid^g. It ^ arts i rain-: broad and vegui: deques:, such as: 
*'Are we getting any results f ram c.^. :ci vision ac 'ert is ■ nc?" \ \ ;:-ou)c 
end up in^more precise form suc^ ac- . ' W'" t is the net ch^jnge attitudes 
and sales resulting from the Se: :nibor-June spot-commer : iai canpaicn on 
NBC? Are there any -di f ferences thr; rttitude and i,a - 3 effects on cur- 
cent users of our own brand, user vr other brands, and -^on-user :,?' And 
so on to w at may be a list of s-? ran tr-iecific questions stemr?':; from the 
same basic problem, 

I n > between the vacue request gp. J tile eventual specific l;s: ; - 

researchable questions, the process o"^ :;• r^lon, re-th; <ing and rztn more 
•discussion at great length is a pro t i' e investTrcnt 

The ir formation sc: :^k*er and - archer shcuK. d thi's cess only 

when both : re mutually agreed t\- rz t' r j,3t of specifi. resear e 
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questions are irdeec tne crucial ones to solve the problem. Th; : 
the researcher nust have the same understanding of v/hat is neec r 
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Review whan: is knov;n about the problem. This preliminary r-r-o--- 
usually called 'secondary research"-- i s frequently neglected. ftr' , . -I'-ces 
of existing knov.vledge can give general or specific facts and gLiidi ' c . If 
the answer to a problem already exists, as is often the case, ~ "'^al 
o'f^time and money can be saved. There's no point ih.repeat/nc a ia'^h 
study that has already been done. Even if no specific answers j-'r • .^d, 
the review o'f knowledge will help to further define the proble irify 
research procedures to be used. 

What are the major sources of existing knowledge? Compar : r ^Zj^er^ 
tisinq agency f i les form one; if a research department has bee * crera- 
tion for. some time, the odds <\re increased thar something usef.. > ' be 
found; . . ' 

Ano'ther. source is the specialized and profess iona 1 jourr- ^<-ich ^ j 

deal with advertising and marketing. Some of the major'^ones a^-. 

Journal of Advertising • ' . 

Journal of Advertising Research 
Journal of Marketing Research 
Journal of Marketing 

Commentary (a Britif^h marketing research journal) 
- Journalism (Quarterly «• • 

Psychological Abstracts. 

These professionail journals contain original articles, boo re ie^r-i, 

abstracts of previous research, and other material which may be percinent. 

Of lesser-importance to the researcher, but useful in providing hrac-grouiud 

and leads to other sources are the.^adverti s ing "news" publ i cati :.>ris :uc^; as 

Advertising Age. roitcjinly, no advertising rooor^vrh drpnr nuoi.t. r-rmi^ l]>-t^ 

without subscriptions to th<-«^« ion»rinVr,; nin«»y city and universi libraries 

al so subscribe. 
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Trade research r~ ::-ir izat Ions are anothe -porcint s. jrce. The 
Advertising Resear :h ~ jr cat 1 3n (ARF) anc the riicustrlc ' iHvsrtisrng 
Research Institute (l-: '; ^-'z the najor cnes. 

The ARF is a hop :'"of - organization supT — ted c: • advcTt isers 
advef^ising agencies ^rrS advertising media. basi : T'urpose is to 

further scientific prr.ctices and remote gre^ : :.. * c: ;;-rtl v^^ness in adver- 
tising and marketing "Through objective and ir^nr- 'tir risearch, Spec**^*- 
ically, ARF offers consul tation and guidri.nce c the ccrcjucr of research 
studies; supervises the technical aspect of advert sing research project: 
evaluates published research stucies conducted by '.ihers. develops new 
research methods and lecriniques , and analyzes e: isi:ing tecnniques; este 
llshes research standards anc criteria; collects and disseminates acvert - 
Ing and marketing dats for tl^ie benefit of its members- / 

' All A-.F publications are automaticail ly offered tto members as they 
are issued. The regular publications are: The'^ Journal of Advertising 
Research , a newslett r, and the annual Conference Proceedings. They also 
issue printed indfvIdLial reports on sup^^ryised studie-H, consultations, 
appraisals, analyses off syndi cated, sen- ces , bibT Dgrapb ies , reprints 
pertinent material Trom arher sources and speeche- . . The most useful ndex 
to ARF publications^ 5 a brochure entitled "Catalc fubl icac ions 

Membership in r-^e ARF. i s a must fcr every coir.:. 3nv or agency invc^ved 
in advertising"; mer:ib::-shic at reduced rates ^ ^ sis: -a-ld by colleges z-d 
universities. 

The lARI is of 'udr-v zular usefulness to invTust-- Tal advertisers, t-^rc-B 
whose advertising is lirected toward specii/iized f-iz-e, business and indi. 
trial custOTT.ers rath: than the qeneral p^t-lic; SL.zn advertisers cust'^^* t 

33 



25- 

.:5e Spec =M;recl different a.v ' sin i-pprcaches. i i 'publishes 

• varief, o' ma' :ri- seme of which is "o t~:£ general advert "i ser. 

Tv;c :i" er ;■ o'-al orgam i zat ' ^pt ■:■ " :o lubl materTal tnai: is 

.iseful: -Jv- Am=- i at i om, of Ac . inn Ac i^nr ies ^Af -\) and the 

-ssociat — of 'r::,:. ^ Ad' -rtisers i-^l-^r- 

Rese-rT:' :h cc ■ 'er —v-s are another us information sov . V/Hile 

these n-a ct b- ava ic^le at the partic ..ir needed .i: specific 

roDlein, ' do -yhey aiwavs cov^er the dei: '.: ,! sjbject ma:.::. ^icv arc 
•nva jab.-, to th -:-::~'nurpg education of - a Jvert i s in.; se^i'-chcr. Also, 
r:ost confe-^nce- .jb' .rn reports on what r transpired. " ne -.f tie more 
important :;nes conduc:: ^in-ually are: t^ American rAssoc M := fc: Public 
Opinic- i-esearc ( AA-0:r:; ^, tine Ac /-rt i s i nc: research Foundati 3nd the 
American Mark-:_i m A?::ociatr on. In addi ior to the speeches and.puDlished 
proceedings, i^-^^ cor- rences offer an "a uable means of r- crson-te-pp.rson 
contact with ot •■•r ac. rti: s i ng rose ; '-'-,.;r5 ; infor-al discL.sJon with them 
often provi-'is ' nfomir: ion uinob t a i n:; h 1 e r. any oth-r way. 

Another m-sjo- sou -ce of i t)For-iar ion Is books — d 1 ibrari - . . There are 
nun'.aro. = boo,-:.5 cr. a j 't i s i ng , r r-iea-. . lethods and narket i nr. - -arch 
which , r - pn. /icu : -land s:. - ;;. ji de-rce to erne soluti ■ problems. 

Thc-i af' --tl-e- _vcjrces of ' on .'ihich c.:.': 6e usee u t'- s stage 

of T-wi ::. ng ... ■ t is K.no'wn -b: , - - p-r- . cular problen. But - nose r^re the 
majc oP:i;. a - 'i be fooi ignore theni. i n ccnsidering any 

rajcr resea^-.^ ■ -s-: O^il- if tris ndary research doe- :^t produce the 

answ;ers ^hc . l e: r::._earcher proceed r 'primary re3earch' -:he Gathering 
of -^ev; i n for^t ' ' . 

:= .^-dc X: -^-ear:::-i *ne:hods. There ire an inf nlte nu ^f ways to _ 

ronciii^-: ar i nves t i Qut ^ on intol.niunr iv.h /?or, Ihf- luo.ihoH • ■ u ves t i gat i on 
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to c • use. depends :n the specific probljn. ar 
is d ffere-i: in sc^.e resoect "^rcm those that ".^ 

/ 

task in ' ':. -i nrisry" -esec^'ch, let's consider br . 



3t everv statec obleT* 
:tic bef: re. As a -irsr 
::he seven ma'or 'rretho-.:^ 

•pendenr vori -ible, t'" 
■*g , rhe des i gr , the 



olo: cal a^.pects In a research investiga: m: r' 
res: ^ns-e nv^trjd, tr.e du.la coWection rnelL..., 

indcpender" variable, -md the research en-j'rc 

The j:^::e.nd:^nt var " ab^ e in a ^esearc s.faC; 
be fTTi^sur , . 3s : is cuii^se..": earlier 'n this chapv:"*" 
ing neigh . tne :iec cr>f! i^n t: v.-'-.'ibie is inc" :-5 ; i wo ght. pcunds; anc' so i. 



. ; rnpl y the quant i ty zz 
For ex.3rp] 2, i, n rreas_" 



In adve.rt g s'*:udfe5 :ns^ol -ing human si.;jjecr? the deoencr". t varia..: ' .3 
depend on tne advern:i5irg gr^a s or objec::ives. "icri--: cf the najor de;:r:^nrent 
variafc^^^e^ in ~:essage research are:- avvar^^ess o'r' the product: kncwleige 
about the product: recognrtlon and reco' i js:: ri;' . jrt i sements ; a':c^itL::5 and 
bell- 's about thie rodjct,. beh^ vt :;r' cr ... :rn' ng I'^.e : roduct s.jch as inqu'ric: 
■ or s^ es. In^mec research rrudles sc ■^■ rec/uent / used C:^]:endent va ' i - 



ables are d?strib ion or circulation, v 



expos J re , sbmet ir 
of t : ::e depender 
chai. .'irs on med i a 
The ' nstrume 
rel i -ib 1 e , and Sen 
meas ures hat i t 
of r eight but no: 



tal ^ehs cle reiic 



■ ea'-cn. 



expc^ti-ure , advert i s \ ng 

ve-iT' ^: le "f reqi:^;ncy 

i n detr i 1 in t':--: 



; ed tc: me.. sure .:he ':^pcrderr Vc iable should be va d, 
ve . V .7 1 i :i i ty o ^ n r easu r ' nc i ^ : rumen t means thr.- i z 



nte-.ded t measure; "inches" i <i valid met^^^umTient 
bod.' tern:." "at.." . '^v;nihr, - v, i pr'vKj-t faces rec-'i^ t 
be c /.^ilid r-ea^'i' ,j r,f ^c^^^i^M bu' ./f -^iLitude to..-^ — 



tne proGjtt. Ir .:vt as ur n t .idv rtisint effect i tnes.:, , the purpose of :.he 
advertising is cri::f;'ion ftr vallcitv nf t-i" dependent variable .r 
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rr.easure used; a measure of learning is valid onliy if cbe p^urpose of :he 

advertisi.Tig is to teach facts. ' ReHabil itvy of a measuring i nstriimemt means 

that it gives consistent rsswlts when the same thing is measured on tvio or 

more occasions. Where a rubber yardst i ck measures ny heicht today at 65 

incnes, and tcmorrcw at 70 inches, then tha measuring instrurrent is 
\ 

*unr§.Viable. Reliability Is a necessary but. ^o" a sufficient condition for 
validity; if today i say tinat two ;d1us tv-;o equals f.a, and tomcr-ow/ 1 say 
the sane thing, I'm bein-g perfect y consistent or reiiable, but completely 
invalid. Precision of a reasurinc inst-rument re-'er^ to itts abilit / tc 
distinguish -between different quantities, the power to d i scr ini rate ; a 
ruler marked off at ono-foot iintervals is not as pr cise as one inar4.:ed c" : ^ 
at one-inch intervals, that is, it c-nnot dl i scr i mi iia^e precisely between 

/ 

fine differences in height. 

. The data col lection- r;i etnod deals ith the specif-; data-ga'-.j in;i 
process -to be used,. of v-'hiich ther- ar. several, "b-e r-ajor kind- o .-.ats 
collection are: intervie-^s by ir.ail, personal -r.d telephone quesci 'jmnai re; 
"direct observation of behavior; -nech- cal recc-ti ig deviices a-f; - .^^stitute 
'for or in addition to personal ob-^e rv,:t i on , incJuding fKnis., photoc-aphs ^ 
and 'recordings; and content analysis c f adverrisinc or other data. Each of 
these data-collection ri-.;-,.Ji is < broad subject of study i n ,- i t -.l A 
correct decision on wi^ • r, • od to us- -lust be on bot- 'hook ■■• 

ing" and actual experi'.i' .. ih v:iri:Mi-, v ,'Ods. 

A decision on re_sjDonse_jrr.ethqd_, when, human -.ubjccts are inv oi'.--d , is 
based on the previous decisions ren.arding dependent variables one ±ata 
collection metinods. The major respronse modes are verba! response f^nat the 
respondent says), bclnavioraO rcDporsc M.ot tl.-- r'-^ponrcnt ro<=v: . and 
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-physiological respc^nse (r jJuntary internal changes in the respondent's 
body) . 

The S3mpl ing zj't data is another variable. V/hether dealing with a study 
of humans or onimals or ina- imate objects, it is almost never possible to 
perform a complete lirver tor , or census, of the whole population. A 
sample of those objects^ me ning a portion that is representative of the 
whole population, iinust be selected. A sample of people, a sample of adver- 
tisements, a sr^nple of television stations, a sample of locations--in short, 
vv'hatever population is invclved, some systematic plan for selection of a 

• V. 

representative portion must be formulated. The most common application of 
sampling is fc . .ci \r resear::h involving human subjects; more details on 

. this procedure are nyen in the following chapter under "The Sample Survey." 
A dec! s: on on rresearch design deals with the frequency and timing of 
data collect. on and the kind of conclusion desired from the study. The 
"after-only" cr "po- i-test" design involves collection of data on just 
one occasion; it is static descriptive study duiing one slice of time. 
The "longitudinal" c -sign involves collection of the same data fromi the 

•same people or sources at several points in time. The "before-and-af ter" 
design measures the change that takes place at two points in time, before 
and alter some event, and r|.ight be considered a variation of the longitudi- 
nal design. Th*^ T^MVo-and-after-wi th-control" design involves data 
collection at two points In time from two different groups of persons, one 

group having been exposed to some treatment between measurements (the test 

> 

group) and one group which has not been exposed to the treatment, (the con- 
trol' group) ; this is actually the classic design for a controlled experi- 
ment, "Tlie principal and most reliable design for determining cause and effect* 
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and the basis of scientific knowledge in r^any fields of study: The "after- \ 
onl y-vjj th-cont rol" design involves data collection at one point in time 
(after sorr.e planned event) from two groups, a test*" group and a control 
group; this also yields cause-and-ef feet informatipn and is a variation on 
the classic controlled experiment. 

/ 

There is one principal distinction i^n, concl us iorrs than can be drawn 
from the various designs. The first three (after-only, longitudinal, 
before-and-af ter) are descriptive studies which can describe the existing 
situation or tell you what happened, but they cannot determi ne why they 
happened--they reveal effects bu\ not the causes of these effects. The 
latter two designs, both involving a control group, can determine both what 
happened and wh>^ it happened— that is, it determines both cause and. effect. 
More will be said about this extremely important area in the next chapter. 

The independent variable is the name given to some treatment deliber- 
ately introduced or caused by the researcher, so that its ef facts ' can be 
measured. Sometimes called the "treatment" va'hiable, it is a necessary 
condition for a controlled experiment. Any quality of advertising that can , 
be manipulated can be an independent variable. For example, if the -task is 

to determine t[\e difference in readership between four-color illustrations, 

/ 

two-color illustrations and black-and-white i 1 1 -jstrat^ions , the researcher 
would construct three ads differing only in those respects; the independent 
"variable in such a case is "use of color." It is the "cause" in a con-' 
trolled experiment designed to measure cause and effect. 

Another research variable is research envi r onment , v;hich may involve 
both a stimulus environment and a response environment. The stimulus 
' (whatever is used to cvoUe a re^o'>nse. from the respondent) may be .a question 
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or an ad or a product or any of a nurber of otjects, depending on the 
problem at hand. The stimulus rriay be admi nTstere'd personally or imperson- 
ally, from a rerr.ote location or! \r\ the same location as the respondent, in 
a laboratory or in the respondent's home or in some other loc^ion. One 
of the most important aspectslof the advertising research environment is 
the nature of exposure — whether exposure to' the advertising takes place 
naturally under real-life conditions of selective exposure, or whether the 
respondent' is forced to pay attention as in an auditorium or studio or 
classroom. In short, natural exposure vs. forced exposure makes a great 
deal of difference in the results obtained in communications research. The 
most desirable research environment is one in whichboth exposure and 
measurement take place in a naturalistic situation without the respondent's 
awareness that he is the subject of research . { 

Conduct the research . After specifing the questions that need answer- 
ing, the methods of 'design and data collection have been decided up^n and 
put down in v^riting in a complete research plan, the researcher is ready to 
actually execute the research pJan. in this phase, the scientific approach 
is fol lovied--the procedures are explicit, the data-collecting is objective, 
the plan is followed in detail no matter how the results turn out. Ex- 
tremely systematic and painstaking attention to detail is necessary. 

Analyze the data . This is the exciting phase oj^ a research study, 
comparable to the thrill of discovery and creation in any field. The pro- 
research preparation may include dummy tables, requi ringVQnly th^t the blanks 
be filled In wi^th percentages or scores or other f i gu res ^^Stat i s t i ca 1 
calculations are performed as necessary, and the figures Vare rechecked for 
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accuracy. \z is '^rliu- r.r ] . possir^e to check ore part of the data against 
another Dart, for v^r " f ; cat icn. V/here results seem illogical, the entire 
procedutre ra\ be recheckeG, to be sjre there is no error. Since most 
adverti-sin., eseorch studies ire quantitative, the analysis stage will 
resjlt in <• number of stati'ic cal tables, summarizing the data in- as much 
detai i as n.ecessary. Sreak.:ov/-5 or cross-tabul at ion-s of the figures may be 
necessary. Depending on tht: ragnltude of the job, a computer may be used 
for ex-ensiive ca 1 cu 1 at Tons ; on s.TiaI I jobs, hand-tallying may be sufficient, 
whUe others may require a calculator or pocket conputer. / 

krterpret^and_n3Port ti - . results . At this point, after all tables 
have be-n prepared, the res.: archer does a ^'f lashback'^ to the specific ques- 
tia-^ns f(ormiu]ated In the fir:;t step, probllem clarification. The principal 
purpose of the study has been to answer those questions. There are probably 
more. data and TOre tabulations than is actually needed to answer ihose 
specific questions. This requires that the researcher be selective, pick- 
ing for initial interpretation only those tables wliich have a direcp bear- 
ing on the principal specific questions. A.ddit'ional tabulations can be 
used to qualify. the principal findings. 

Regardless of the complexity of the coimplete study, a short clear ^ 
understandable report of the principal concilusions must be produced; on 
the other hond, the report must be complete, reporting all the data, the 
methods used', and so on.- One v-^ay of getting around this dilemma is to 
prepare a "three-stage" report. Part I consists of a. simple straight- 
forward oine-p5ge report of the principal cone 1 us ions — the specific problem, 
and a short rfon-technical statement of the principal findings without 
qualifications." Par.t II is a somewhat expanded version of Part I, showing 
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the key tables supporting the principal findings, and mentioning the 
oecesoary qualifications for those conclusions. It should also contain a 
brfef statement of the research methods used. Part III is a complete 
technical report, with a full detailed description of methods used at all 
steps of research planning and all the tables or other data produced by the 
study. ** ' ' . .. 

Parts I ("executive summary") and II should be free of technical 
Jargon and should be understandable by non- research persons. A great deal 
of advertising research has been wasted because the final reports were too 
detailed or too technical. Research is useless unless the results are 
used in decision-making. Decision-makers can''t use the results unless they 
.understand what you say. The best safeguard in this respect -Is to Tiave 

someone who is unfamiliar with the project read. the report before distribu- 

- ■ - . p 

tion. ' 

Other PartTcipaats in the Research Process . , 

These steps involved in a research study have been discussed as though 
one person or organi zat ion were actually doing the -whole job. In fact, 
various consultants and sub-contractvors may be brought in at various stages 
the- amount of outside hel,p depends on the size and skill of the advertiser' 
•or' agency's research department , the size and complexity of the research, 
time avai .1-^oleN^ money available, and other factory. 

"Defining 'the problem" is usually handled by the advertiser and/or the 

... ... . '■ . 4 

agency, without outside help. 

• "Secondary research" is usually also an inside job, though university 
■researchers 'or> other specialists may be called in for certain jobs. 
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In the primary research phases, however, consultants and commercial 
researph firms are frequently used.. Data-gathering in particular is almost 
always farmed out to commercial firms which have standing f^orces of field 
interviewers. Data analysis, after the data have been collected, may be 
sub-contracted to a computer data-prOcess ina firm, which will provide all 
statistical tabulations required. Some commercial research firms will 
perform both data-gathering^and data-analysis; others are specialists 
for only one of those functions. 

While sub-contractors may provide their own interpretation and report 
of the results, the final interpretations and reports are usually accom- 
plished by the sponsor. 

The wide range of commercial research services availablp are illus- 
trated in two publ ications-- Bradford' s Directory of Marketing Research 
Agencies and the ARF Directory of Research Organization Members . 

V/hile all parts of the research process are important, the, first step 
(defining the problem) and the last step (drawing ^n^lusions) ace prob- 
ably most important , and only the 'sponsor ing advertiser or agency can 
assume final responsibility for their correctness. 
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CHAPTER III, 
THE 'most common ADVERTISING RESEARCH PLANS 

> 

Certain kinds of research procedures are more common than others in 
advertisiag research. These will be called "advertising research plans/' 
and each involves a pa rt i cul a r conf i gura t i on of, design, data collection 
met|;ibd, research environment, and other variable's. 

These ''most common" research plans are applicable to a wide variety 
of' advertising problems, and many specific applications are .given in the 
chapters on Med i a Research and Message Research. At this point, however, 
a general des^eription of these pop.ular research plans will give a broad 
understanding of %vhat is, to follow. 

The most common ones are the sample survey , the survey panel , the 

labo ratory experiment , the controlle d field experiment, controlled pbserva- 

tion , conten t analysis ^ud attitud e measurement . 

f 

Each will be discussed in terms of^ several characteristics: research 
design, data collection method, response method, research environment, 
dependent variables, independent variable, and sampling procedure. Some 
of these features have heen:di scussed in earl i er chapters . , Response 
method can stand a 1 i 1 1 1 e el aborat i on a t this' 'point before detailed descri 
tion of ^ch pi an. • 

Three re sponse methods . ' A person ' s response to any stimulus may be 
measured ,in one or more of three ways: behavioral , physiological , and 

* 

verbal . - , 

wlien a person deliberately takes some sort of observable physical 
action, th;s is known as a behavioral response. Behavioral response to 
advertising can take the, form of visiting a dealer, mailing -a coupon, 
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talking to friends , 'borrowing a product for a trial, or buying a product. 
The ultimate criterion, of advertising effectiveness is, of course, a ■ 
purchase"a behavioral response. . 

When something changes in a person's internal mechani'sm, thi s is 
known as a physiological res:>onse--an involuntary reflex action, usually 
uncontrollable by the person. Physiological response is reflected by 
heartbeat, sweating, breathing, electrical output of the brain, muscle 
contraction, and eye pupil size,"" Since physiological response cannot be 
determined ^ery accurately by observation, a person must be connected to 
some sort of laboratory appa^i^tus to get accurate measures. Such changes 
are often too subtle to be c uch use in measuring response to .messages. 
However, all of the above re : onses have been used in advert is ing. research. 
One of--the most promising of chese at present is eye pupil size or / 
"papillary response"--the pjpl.l dilates (grows larger) when a person is ' 
exposed to something unusually pleasing, contracts (grows smaller) when * 
exposed to something unusually displeasing. Brain wave measurement by 
elect roencepfia lograph (EEG) has' a 1 so been found related to communications 
effects, y X 

When a person responds to a stimulus v/ith words/ either spoken or 
written, this is know as a verbal response. Probably* the great majority of 
advert is ing , research takes this form. Mail questionnaires, telephone 
interviews and personal interviews are all primarily measuring verbal 
responses. This is the most indirect measurement of the three types, con- 
sisting of reports, of v/hat a person says he thinks or feels or does'. Such 
reports must ^Iways be taken with a "grain of salt, since verbal, responses 

are quite controllable by the resporfdent. A great' deal of methodological 

- ■ *, ■ ' . 
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research has been done to *ne what sorts of biases and errors are 

obtained, and to refine ques . ' ing and interviewing techniques to reduce 
verba.l response error. Desp its 1 imitations , the quest ion-and-answer 
survey is the most wideYy^used data-collection method in marketing and 
advertising research. In those situations where it is 'poss i bl e ,^to obtain 
behavioral or physiological response data, they are to be preferred over 
verbal responses if it is practical todo so. 

r' , ' ' 

The Sample Survey 

The sample survey-somenL^esi called a field surve\ :t a poll or simply 
a survey-- is the most frequeTitb^' used acvertlsing research plan'. Basically; 
it may be described as askin._:, qiiestions of a sample of persons who represent 
some larger population. 

Distinguishing feature -n terms of the research methodjj already 
discussed, the sample surve- . be described as follows: 

Research design: -lot 
\ Data collaction nr. quest ionha ire : personal or , ma i 1 

\ or tel ephoH:;: 

:' Response method: { ^^:\ report 

Research envir-nmeut natt" al , real- life (usually at home)- 

Dependent var le5, : awareness, knowledge, attitudes, 

buying ^ rtfer-nces ( .e., any verbal izable response). 

Independent V£ - ab:ee; node 

Sanipl ing: usu j i iy random , , . , 

The complete sample survey procedure, after clarifying a problem to 
be 'invest igoted, includes successive stages of planning the sampling, 
questionnaire construction, data col lect ion and data-processing. Let's 
discuss here the most crucial technical aspects of these stages- in the 
personal' interview sample survey. . " ' 

Samp,l ing . Sampling is the procedure by which the researcher can 
determine the characteristics of a large number of people (a population) by 
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analyzing just a few of them (a sample). Sampling is necessary becausj it 
would be impossible or financial ly prohibi tive to talk with all the persons 
in a given population. Fortunately, it has been demonstrated time and time 
again that a sampler- chosen in the proper way- - i s representat 1 ve of the 
population from which it was selected. * 

First, let's dari fy "population." Before sampling, a. popu: on, 
must be defined in terms that are meaningful to the specific proitiir • In 
advertising, this is frequently a population of prospects for rhe ^prrcuct^ 
The population in a survey for a soap manufacturer might be "a 1 ac^^^l'cs 
in the U.S." or '.'all adult women in the U.S." or "all adult marr^ v/cru-n 
in the U.S." or "all adult married, women wlho used pov/dered soap tb£ 35t 
year ." Th^ purpose of the survey* and. the nature of the problem arA tlr- 
kind of product involved, £1 1 must be considered In arriving at a very 
cise verbal description of the target population. Only then can the 
researcher consider drawing a representative sample from that pc:;ul3tion. 

Frequently, after defining precisely the target population, it is 
necessary to >»f i rst select a sample from a larger population, then screen 
out with appropriate questions the persons to represent the tarrr^t popula- 
tion. In the case of the soap manufacturer mentioned, before , there is no 
master .1 i St. of "al 1 adult married, women who used powdered soap in the last 
year"; therefore, the r.eS^rcher woui;d first select a sample from the "all 
U.S. households" population, then ask some screening questions to determine 
age, sex, mar i tal, status and soap usage--ending. up wi th* a smal 1 er 'group who 
are a representative sample of the target population. Only the target 
population sample are then^afeked the questions pertinent to the problem 
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■ . It is not uncommon for non-researchers to be very skeptical as to 
v/hether a small sample can real ly be representative of a lar^^e population. 
How can a sample of 1,600 persons fn an election survey be a-n accurate 
reflection of the entire U.S. population of 100 million voting adults? 
There is not room in this book to go through all the mathematical proof 
and empirical verifications of sampling theory. For full understanding- 
and acceptance, it is certainly desirable to study the subject further. 
For the moment, howWer, you are asked to accept the assumption that ^ 
scientific s amp 1 i nq/o f human popu'^ations is. a valid procedure that has 
been proved in practice. National election usual 1 y. accurate wi thi n 

one or two --percentage points, prc-y de pa^'M^ iroof. . 

The first s tep In sampl i^ng is :ecidlrv, or : sample size , the number 

J ' ' . 

of people to be interviewed. The next step decidi^ng the method of 
selection , the procedure which will insure ge,:ing the right people from 
the right population. ' . ^ < . , 

In the discussions of sample size and method r)f selection that follow, 
assume that- the aim is to draw a sample from the population defined as. 
''all adults living in IJ.S. households^" 

The desirable sample size wi 1 1 be affected by the populai:ion homo-- 
geneity, the sampling procedure used, practical considerations of time 
and money and^ personne 1 , the desired precision of the results, and the 
degree of confidence desired In .the results. ^ 

It may seem strange that size of the po^ulatipn has nothing to do 
with sample size. *A. sample of 1 ,600 persons is just as meajiinjgful for 



the entire U.S. as it is for a single city, everything else being equal 
tha.t is, the sampling error is the same in^both cases. 
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Homogeneity simply refers tc the degree .to which people are alike on 
the characteristics being studied. If everyone in a population were 
exactly alike, one person would adequately represent the whole group. The 
more the people in a population are ali^ke, the sma ^er the sample can be. 
In most studies, how'evjT;^ Tittle Information j-n homogeneity is avatlab 2 
and this, deterrrmant ct sample sire > ' \gncr^d. 

Time,' money cind cersonnel aisc a^^fect sarrrple size. Regardless ov the 
other considerations,, Ir there is a limited a.-nount of time, money or 
people to do the isampfe sine must ru::uced appropriately. 

The number o i-'yLi^.or i es into whi: :he collected data will be ar ilyzed 
^- 50 affects sampL^e iz^-. The more braa !ov;ns used-'-as by sex or* age or 
:jcation or race^-the Tger the total : imple needed in order to get a 
ningful number in eacn breakdpwa or cr ss-tabulat ion. 

Amount of pr cisior required also derermMies sample size. That is, 

'f it's necessary that esults be accura: within five per cent, a larger 

f 

sarripl:: is require:, than if accuracy within ten per cent is tolerable. 

"^he expected occurrence of a characteristic will affect sample size. 
This be known only roughly in advance, but if a split of 50~50 's 

expected in a two-cho i ce^s ituat i on (say, a national election), a larger 
sample^ is needed than if a 30- 70 split is expected.. 

Finally, the degree of confidence desired in the results affects the 

size of sample. If 70 per cent confidence is desired, a smaller sample is 

required than if 95 per zent conf ' Jence i 5 needed . Sir^nle tables of sample 

:3i7P requirements are available in most "-books on survey research and can 

be mastered w5th a few rfnutbs of study. 

Once the correct sample-size is dete mined, there are several ways 

• . *^ ' ■ ■ 

of going about the actual sample selectic process. A random sample Is one 

i . ' 
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in which every individual bas an equal chance of selection, './hen a complete 
popi/lation listing of namci or households is available, a systematVc random 
s amp I e can be drawn by designat ng units at ^equal intervals tnroughout the 
W^t^-or example, to draw a sa-^ple of 200 from a listed popi- ation of 
200,000, you v;ould go down the "\st chocs' ng each 1,000th na^ -. A simple 
random sample is obtained by assigning a number to eve y uni in a popula- 
tion, then selecting the sample members T'rom' a table ot random nunhers. 
An area-proba bility sample is d-awn by marking off a geographic area into 
segments (say, census tracts J , '::hen chocking from a .tabje of randor numbers 
enough of; the numbered segments to give the desired sample- s ize. 

The" mechanics of drawing a sample ere too detaMed to be spelled out 
here. There are non-random procedures (less acceptable) such as quota 
sampling, availability sampTtng^and others which will not be discussed 
here. The basic general rule, however, is that ho personal biases of the 
sampler or thci interviewer should enter into'the selection. Sampling 
directions should be specified before an interviewer ever goes into the 



field — specifying exactly vyhere: he-should go and who he should talk to^. 
Even: .the most conscientious interviewer will choose the convenient houses 
and pleasant i nterviewi ng s i tuat i ons , and avoid unpleasant or dangerous- 
looking locations, if left to his own judgment. This would lead to a dis- 
tinct bias in the survey ■ resul ts . Furthermore , -there must be no substitu- 
tions in the original sample as drawn; if a person cannot be located the 
first time, a certain number of callbacks (usually, a^ least three) must 
be made. Even Ihen^^no substitution is made, since this too would result 
in some bias. An 80 per cent completion rate for a selected sample is 
considered good\ while 50 per cent completion is considered the minimum 
rat^ for unbiased results. 

( 
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Inssummary, the principal rule In drawing a sanir \ \'> to deliberately 
make as many decisions as possible by chance--f 1 i pp i ng a coin, choosing 
numbers, from a random numbers^^le, and so on. This insures that whatever 
happens is completely absent of personal biases/ Almost anything that Is 
decided subjectively, rather than letting chance decide, is liable to 
distort the survey results. Understand, "chance eelect'on" is not the same 
"haphazard selection"--rather it is a highly del iberate mechanical procedure 
that is set up to insure a random and therefore representative sample. 



Questionnaire construction . The quest i onna i re i s the heart of, any 
sample survey. No matter how carefully the other survey stages' are car- 
ried o^t, if.-the right questions are not asked, or if they're asked fn 
such a way as to distort the results, then it's all meaningless. 

Questionnaire writing is an art, rather than a science, and even t:-e 
most experienced survey researcher folloV.s this general -ule; w^ite ques- 
tions, pre-test them on small groups, revise the ques'icnis, then pre-te'5t 
again and^so on until ^he is satisfied that the questions and the question- 
naire format will give the d(3S i r^ information accurately. Five or six 
pre-tests and revisions aYe not uncon^^n; the most experlsrrced question 
writer is usually surprised at the varitty.of meanings which respondents 
g,et from questions that seemed perfectly clear and dipecT to him. 

Let*s consider here four aspects of questionnaire wr i t i ng--quest Ion 
'subject-matter, question structuring, questio- wording, anc question 

sequence. ^ 

'' Subject-matterJ ' refers to the kind of inforrration that is needed 
' from the re5p6ndent. Most of it can be classified as. facts, opinions, 
knowledge, and reported behavior. A "fact" question asks the respondent 
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for some objective descriptive data about himself--his age., sex, income, 
marital status, occupation, religion, race and so on; such information is 
often referred to as "demographic data" or "background data" or "classifi^ 
•cation data." An "opinion or attitude" question asks the respondent how ^ 
he feels abodt something, rather than for objective facts. Generally, a - 
person's feelings for any object--a product, a political candidate, an 
advert i sement--can be determined as for or against, favorable or unfavor- 
able, likincj or disliking, the object. All such feelings may^not be a 
simple choice of for or against, and different degrees of feeling may be 
obtained by .appropri^tfe attitude scales, discussed in more detail els.ewhere 
in this chapter. 

"Knowledge" questions attempt to find out what the respondent knows, 
how much he knows, and the source of his knowledge, about various top'i-'cs; 
Since answers to knov/ledge questions depend on memory, s'^metimes U may be 
desirable to use aided-recall or recognition questions; knowledge about ^ ^ 
advertising, or about a product or about the . mass media may be hiore easily 
elicited in this way. ^ ..^ ^ 

"Behavior" questions ask the respondent to report pn'some action he 
has takea--what products he bought and when, which media he has seen or ' 
heard recently, and so on. Reported behavior is not always the same as 
actuol behavior, because of fau 1 ty memory or a desire to please the inter-, 
viewer or other reasons. Consequently, advert i s i ng researchers go' to great 
lengths to verify and- cross-check such answers, and where possible they jturn 
to actual observation of behavi'or rather than rely 

example, a "pantry check"'of products purchased is. sometimes used -instead 
of questions about products pjjrchased. . ^ 




verbal reports- for^^. . 



''Q uestio n structuring" refers not to how a 'quest Ion asked, but to 
the form that the respondent's reply takes. ^ A completely "unstructured" 
question allows^the respondent to answer in his own words, with the inter-* 
viewer recording just what is said. The completely "structured" question 
forces^ the respondent .to give one of several predetermined possible/ 
answers* Each has advantages and disadvantages for specific purj^oses. 

An unstructured question--al so knov/n as an "open-end'^ or "free 
response" quest ion-^-encourages the respondent to talk freely about the 
topic at hand. It's especially useful when the researcher doesn't knov^ 
in advance what kinds of answers to expect or when a great many different 
kinds of responses are expected, or v/hen he v/ants the respondent's own . 
thougfits on a subject before asking specific questions, or when he wants 
to get at underlying, mot ivatJons . But the unstructured question has some 
disadvantages the interviewer must record the answers almost word for 
word,. v/hich may take up considerable time arid requir^ considerable space 
on the quest ionnai^re; if the interviewer abbreviates the answers he may 
distort the meaningj or the abbreviation may not *be clear to the person 
who later analyzes the answers; since the responses of many people must 
.usually be summarized into. categories , the anal yst ' s^ category system may 
not accurately reflect what t.he respondents actually thought. 

A structured question presents the respondent with a limited number 
of fixed answers to choose from. This may range from a simple "yes-no" 
choice, to a lengthy list nf multiple-choice responses. Since the ansv/ers 
are prc~cotIcd with letters *or numbers, the interviewer has an easy job 
recording the answers, and the analyst has an ea-sy job tabu 1 at i ng -the 
responses. The primary di sadvatttage is that the respondent is forced into 



a specific ansvver which may not completely reflect, all he thinks about the 
topic. 

Question wording deals not with what is said, but how it is soid. 

~ ■ ■ ■ I. — — ■ " t ' 

People will answer highly intimate .personal questions if they're asked in 
tfie right way, or they may balk at answering simple impersonal questions 
if the approach is clumsy. The respondent may misinterpret a question 
that is poorly v;orded, and the survey results will be misleading. The best 
form of insurance against faul ty quest ion wording is pre-testlng--this pre- 
liminary tryout of a questionnaire, a;id subsequent revision., will catch 
many wording errors. 

The kinds of wording errors are infinite, but three of the major kinds 
are ambiguity, misperception, and loading. Ambiguity means that a question 
has more than one. mean i ng ; i f some respondents interpret a question one 
w^y: w'hi le Others interpret it another, the summarized results will be mean- 
ingless. Misperception refers to the use of words unfamiliar to the re- 
spondent. A loaded question is one that suggests a particular response 
more than another, or one that is biased in a part i cu 1 ar d i rect ion . 

Other wording problems ^arise from assuming too much knowledge on the 
respondent's part, from overly-lon^ and complicated questions that are 
difficult to follow aural ly, from 'the. use of stilted language that sounds 
unnatural to th'e respondent, fromjthe use of double negatives, from Hlog- 
ical sentence construction, and many other sources. i t cannot be over- \ 
emphasized that pre-testing, alon'g with knowledge of the survey subject- 
matter and of the kinds of respondents i n the sample, is the best guarantee 
of correct v;ording. / • 

Q.uestion sequence deals with the order in which questions are asked. 
Even though, individual quest ions, may be properly written, the sequence can 

53 



k6 

affect and distort the reagonses. 

Before a questionnaire goes directly into the crucial questions of a 
survey, 1t is often desirable to get the respondent into the riight frame 
of mind through the use of an i ntroduct ion *and some warm-up questions.) 

The introduction Includes the interviewer* s very first words to the 
respondent and everything up until the first question is asked. V/hile 
the introduction should be written out, the interviewer should f.ry to say. 
it to the respondent in a normal conversational manner, rather than appear 
to read it from his questionnaire; The purpose of the introduction is to 
identify the interviewer, his sponsor, and the^ broad nature of -the survey. 
It shou!d be short and worded in everyday language. It should be straight- 
forward, since a humorous or frivolous approach might convince 'the respond- 
ent that his time-VN/ould be wasted. It should be neutral and non-partisan, 



otherwise some respondents might be convinced thiey're dealing w^Tti an'"*^'''^ 
enemy. It should be firm and matter-of-fact in assuming that the respond- 

X 

ent will cooperate rather th^n ask for permission to cbriduct the interview. 

f« The purpose of warm-up section is to put the respondent at ease 
with simple easy-to^answer questions. They may be irrelevant to the survey 
and never be analyzed. Where possible, however, if they can serve the ^ 
basic purpose and at the same time provide useful -i-nformat ion , so much t-^he 
better. 

Past t'-e warm-up stage, the real questions start. One general rule 
is to start with unstructured and general questions and gradually viork up 
to 'the structured and hVghly specific questions. Another rule:- if^the 
words in one question suggest answers to another question, then the sugges- 
tive question should appear after the other. 
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Once the main questions in the heart of the questionnaire have been 
v/ritten, the questionnaire should conclude v/ith the demographic or classi- 
fication questions dealing with facts about the respondent--age,.*ed;ication, 
occupation and so on. 

To summarize, the generally accepted sequence of items within a 
questionnaire is: introduction, warm-up questions, questions dealing with 
the principal .subject-matter, and finally the demographic questions. 

t nterviewi nq . After a questionnaire has been wr i tten , pre-tested and 
rewritten (perhaps several times), the researcher must assemble interviewer 
materials and brief the interviewers. 

j ntervievNfer materials usually include some or all of the following: 
three- ring notebook, map of the interviewing area and speci fic , addresses 
or names to call on, the correct number of blank questionnaires identified 
by case number, extra questionnaires for mistakes and practice, a letter of 
introduction, income cards or other materials that wfll be shown to the 
respondent, instructions and tips for interviewers expense forms (for 
time, mileage, etc.) and a writing instrument. 

The degree of briefing and training depends on the complexity of the 
survey and the experience of the interviewers. Before going to vyork, even 
trained i nterviewers need at least one briefing session to familiarize 
themselves with the questionnaire and the respondent selection procedure. 
A briefing session may include a demonstration interview by the supervisor, 
followed by questions on , procedure. It is often required that each Inter- 
viewer conduct one or more practice interviews with outsiders, followed by 
another briefing session with the supervisor. 

It viould be impossible in this short, space to provide a complete 

; . . . • DO . 
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''how-to-do-it" procedure for interviewers. Much research has ^been done 
and books written on various aspects, of interviewing. Some general in- 
structions are: alv/ays follov/ instructions carefully; study the question- 
naire for complete familiarity; be neutral, informal, conscientious; read 
the questions to respondents just as they are v;ritten; ask all the ques-- 
tions, and in the order written; record comments completely and accurately; 
interviev/ only at the place and with the particular person specified; check 
each questionnaire after the interview to insure completion of every item. 

V There are certain characteristics common to good interviewers: 
they're generally interested in people; they're able to inspire confidence 
and put others at ease; they're inconspicuously but neat ly dressed. Mature 
women are generally highly effective as interviewers, except for special 
kinds of samples.^ 

Verification of a small proportion of each i nterv i ev;er ' s v;ork is a 
standard practice. The chief interviev/er or research supervisor usually 
conducts this by telephone with a few respondents, asking just a few 
questions to check on the interviewer's performance. Fa 1 s i f i cat i on . or 
error in these verification interviews can lead to scrapping an inter- 
viewer's work and dismissal. 

Cniteria for evaluating the sample surveyC because of the extensive 

use of sample surveys, and their importapfcei n making advertising decisions, 

the Advertising Research Foundat ion h^s published a list of criteria to be 

used in conducting and evaluating such studies. Any one of these rules, ♦ 

if viol ated , 'may invalidate the results.. 

1. Under what conditions was the study done? A 

statement of the method employed should be made 
available in such detail that the study could 
be duplicated therefrom. 
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2. Has the questionnaire been well designed? 
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3. Has the interviewing Seen adequately and 
reliably done? 

k. Has the best sampling plan been followed? 

5. Has the sampling plan been fully executed? 

6. Is the sample large enough? 

7. V7as there systematic control of editing, 
coding.and tabulat iOn? 

8. Is the i ntprpr et^v / on forthright and logical? 

The ARF l>(c»«„lMjf c on "Criteria for hat kt^r lUij^oiiJ Advert ?*; / ng Rc5^orch'* 
.-.„i*n;o*-- r> f c^f, - /' w /f't ; vjf the crucial evaluation points." 

They parallel some of the points already made inQ^ preceding discussion 
on the sample survey. 

The Survey\Panel 



The Survey panel is simply a saifTple survey in which the same sample 
of persons are interviev;ed on several occasions. 

Dj_st inquish inq features. The panel survey differs from tlie sample 
'=;uivcy on the following reseorch methods: ^ 

Research design: longitudinal 

Data collection method: usually mail 

Sampling: Rarjdom sample of agreeable long-time respondents 
The survey )anel has certain advantages and certain disadvantages 
when compared with surveys conducted with different samples of persons. 
It permits^ tracing changes in awareness, knowledge, attitudes and reported 
behavior of the same persons over time. It permits the gathering of cer- 
tain standard data, such as demographic characteristics, just once rather 
than in every survey. Some research companies have standardized ,cont inuing 
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panels with several participating sponsprs; this means that questions on 
one sponsor's topic is mixed in with questions from other sponsors to 



There are two principal disadvantages. One pertains to the kinds of 
people in the panel; people who agree to participate in a panel, usually 
for cash prizes or premiums, are not typical of the whole population in 
many ways. Another disadvantage is the "conditioning" of the panel members; 
after a number of surveys, ihey often become sophiscicated or "test-v/ise" 
and don*t respond in the normal fashion of a naive respondent. 

Panel surveys are widely used for certain purposes, lt*s up to the 
individual researcher to determJne whether this plan is suitable to the 
problem at hand. , . 

The Laboratory Exper imen t 

The laboratory experiment is the classic plan for conducting con* 
trolled studies on human respondents. In this plan, a small number of. 
people can be studied Onder highly controlled conditions, thus assuring 
uniformity of the research environment, control of the treatment variables, 
and various other factors- 

Distinguishinq features . In terms of the various methods- employed in 
a research plan, the laboratory experiment may be described' a^ follows: 



Research design: treatment and control groups, pre-test 
and post^test 

Data col lection method: observation, mechanical laboratory , 

apparatus, personal interviev; 
Response method: verbal , behaviora 1 , physiological 
Research envi ronment : art i f i ci al > unnatura 1 exposure 
cond i t i ons ^^^-^ 



reduce research costs. 



Dependent variables: all 
measures, some behavj. 




h and physiological 
reasures 
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Independent variables: controllable as desired 
Sampling: non-random, convenient, available subjects, 

small sample. No -.l-^im "O being representative 

of a population. 

Advantage s an d disadvantages . The principle advantage of the labora- 
tory 3xperiment is its ability tc determine cause-and-ef f ect relationships 
between an advertising treatment (cause) and ah immediate response (effect) 
This is achieved through control over the treatment variable, use of a con- 
trol group, and the research environment. A great variety of data- 
collection teci^niques and response methods may be emp.loyed. 

The principal disadvantages are an unnatural research environment 
and a non- representat i ve sample. The research environment usually creates 
forced attention to the treatment variable, often from a h ighl y author i ta- 
tive person under cl ass room- 1 i ke conditions where the respondent is moti- 
vated l:o do his "best," a situation quite different from the normal adver- 
tising exposure situation. The subject is aware of measurement procedures 
which tend to be obtrusive and reactive. 

Previous research has shown that laboratory experiments tend to give 
different results than sample surveys for a variety of reasons one differ 
ence is that' sample surveys tend to show either extremely small or no 
changes in attitude as a result of exposure to advertising, while labora- 
tory experiments tend to show significant changes. There is a strong 
suspicion that laboratory experimental conditions may artifically inflate 

• '/ ■ 

the effects of communication. y] 

Nevertheless, laboratory experimentation has produced most of the 
evidence, regsrdiog coini.iun i cat i ons causes and effects. And it is the only 
method suitable for tightly controlling certain advertising message vari- 
ables which would be unmeasurable otherwise. 

. . . ■ ' .'59 ' • • • ■ 
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The Controlled Field Experlrrent 

The controlled field experiment (CFX) is probably the most 
sophisticated and^most val id research plan used in ad^rt i s i ng research. ■ 
Not only can it^^pture the advantages of the tv;o most widely used, plans — 
the sample survey and the laboratory experiment — but ?t avoids their dis- 
advantages. It can measure cause-and-ef feet under natural conditions of 
exposure without the subject's awareness that his reactions are being 
measured. It is also expens i ve , t ime-consum i ng and requ i res the most- 
rigorous design and execution of research planning. 

It lends itself to measurement of the'm^st important. questions in 
advertising, research. How< much money should be spent on advertising, and 
hov; should it be spent? Which media or combinations of media should be 
used, and how? Which messages or campaigns are most effective? Results 
can be measured in terms of behavioral response--notabl y sales — or verbal 
response, or both. 

The controlled field experiment — or CFX — will be described here in 
some detail because of its importance and value. 

Each of the words in the name of this plan are keys to its distin- 
guishing features. 

Control led means that the researcher controls media placement, message 
production and distribution, artd manipulates the form the advertising takes. 
For example, if the purpose is to measure the difference in effectiveness 
of tv;o campaign themes, A and B, the researcher produces the two campaigns 

to exact specification, then insures that one group of respondents is 

' . /-^^ ^ 

exposed orily to Campaign A and the other is exposed only to Campai'^^B. 

Field refers to the speci fi cat ion that respondents receive the message 
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"in the field" under naturalistic conditions rather than in a laboratory 
or other artificial situation. They receive it under real-life conditions 
of selective exposure, without awareness of receiving anything special, 
or of being involved in a research project at all. Consequently they pay 

rt.i tural attention as they normal ly do and also res/ond natural ly . Simi- 

/ 

larly, there is often no awareness that responses will be recorded; 
behavior and particularly purchasing behavior can be measured through sales 
registration or aud i t i ng" records . ^ il)ider Tio condition should subjects make. 

a conscious connection betweervthe advertising received, their subsequent 

/ / 
behavior, and the measuring process. ^; 

Experiment means that\the study contains the essential elements of a 

scientific expe r iment--one or\more treatment groups, a control groUp and 

randomization of subjects to treal.nents. In the siraplest form, there is 

one treatment g'Voup and one control group of respondents; the treatment 

group receive&^the test message, the control group does not. Measuring 

the responses of a control group reveals what would have happened without 

the advertising; the net difference in the responses of the treatment and 

-control groups reveals the incremental effects of the test advertising 

over and above everything else that has transpired in the test period^ 

Exampjej_^ testinq campaign themes by CFX . The following simple 
example wi 1 1 illustrate its principal d.i st i,ngu i sh i ng characteristics. 

Assume that the advertiser has a nev; brand of toothpaste called 
"Sparkler-Dent." It has been on the market for a short while, has received 
some publicity but no extensive advertising. Two distinctive features, 
have been established in product . research-- i t actually gets teeth white 
and it really stops bad breath. To conduct a nationwide newspaper 
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advertising;campaign, v;h]ch advertising theme should be used In a newspaper 
carnpaign--*'white teeth,'" or "sv;eet breath''? This question can be^ansvjered 
by a controlled field experiment in a limited area before embarking en a 
nationwide campaign. The advertising agency is instructed to prepare a 
month-long nev;spaper advertising campaign (20 full-page ads, one each day 
on Monday through Friday for four weeks) for each treatment. One group cf 
prospects wiTl be exposed to the white-teeth campaign and a second group 
to the sweet-breath campaign. A third group, a control group to receive 
no_ advertising of the new toothpaste, i'^ added for reasons that will become 
clear. 

The researcher then selects 12 cities which are similar in a number 
of crucial respects--popul at ion, toothpaste usage, income, one daily news- 
paper in each, and other population characteristics related to toothpaste 
buying. 

The first step is to randomly divide the cities into three groups, 
^ach to receive otny one of the three treatments. This might be done in 



several ways 



^he simplest is to put .each city name on a white card, 



^shuf f 1 e^'^fcsb^ cards thoroughly, then deal them into three piles sight unseen 

as in a card game. 

The next step is to randomly assign the three treatmeffts to the three 

.^-...^Xnijps ; this may be done with three cards shuffled and dealt blindly to 

the three groups of cities. ^ 

This vjill provide an arrangement like this: 

^ Campaign A (white-teeth): Cities 2, 5, 11, 6 
Campaign B (sweet-breath): Cities ^, 7, 8, 1 
Control treatment (no advertising): 3, S, 12, 10 

. Space has been purchased in the newspapers of the twelve cities for 
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the test. The next question is, v;h3t dependent variables should be 
measured? This depends on the advertising goal for the product-- i s the 
goal increased awareness of the product's existence, increased knowledge^ of 
its good features, improved attitudes toward the brand, or simply the 
ultimate criterion of success, sales? Any or all of these dependent vari- 

c 

ables could be measured. Since sales rr-easuren-ent is feasible for this 
product 'and is the most crucial measure of effects, sales is chosen as the 
dependent variable in thls^xanple (in practice, all of these^ dependent - 
variables an'd more plight be used.) Sales will be measured both before and 
after the campaigns, so firm dates for the measurpent and advert ? s i .-^q are 
set, and the test is lounc'ied. 

The time-diagram below illustrates the execution of the test and the 

. 4 

results obtained. 

■i 

January February Harch 
Sales'-^ be.fore Pages of newspaper S ales- after 
advert i s i ng advertising advert i s i ng 

Compaign A 5% (20) 17^^ 

Campaign B > " ^ (20) . 20 

Control 5 ( 0) 10 

-(Proportion of newspaper-subscribing families 
purchasing one or more tubes of Sparkle-Dent 
toothpaste. ) 

The results from the preceding diagram can be reduced to a simple 
statistical table and the results analyzed as 'follows. 

Sales f^et Change due 



Campaign Before After Change to Advertising 

A ' SI ' M% +12 + 7 

•B k 20 +16 +11 

Control 5 10 + 5 
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Note the ^'before advertising" coIuTjn. The different city-groups are 
approximate Fy but not exactly equal in Sparkle-Dent sales, a random varia- 
tion encountered almost anytime that samples are used. Statistics tables 
can reveal just how much random variation is tolerable v;ithln the bounds of 
chance. V/hy the five per cent sales level before advertising? Because the 
product has been, aval lable for avvhi le, though not v/idely advertised; only 
rarely does any product measure "zero" sales. 

Now note the results from the ''contr' :rea':rnent. Sales increased 
frc:Ti five per cent in January to ten per cent in March even though these 
cities received jt£ test advertising. This illustrates the real reason 
for a control group; it reveals that many other things were happening in 
the toothpaste market apart from our test advertising. Shoppers were 
seeing it on the shelves and making impulse purchases; v^-^rd-of -mouth influ- 
ence was operating; possibly other promotion or publicity ^^'n^ "n '"^rce, 
since in a large company it's almost nevei .^tb.- to completely black- 
out all 'promotional activities once they're started. The major point:, jmJ 
it is a very important one. ' this: i' there ' ^ ' n \\C control group, 

It would ho imposs i bl e to determine the magni^icit of all tf ,.?^:.fices 
on sales apart from the test newspaper advertising. As it Vis, the changes 
in the control group are merely subtracted from the changes in the other 
treatment groups to provide a true measure of the treatment influence. To 
j^epeat a basic principle that Is essential in any form of research: one 
can never determine accurately the effects of any treatment unless there 
is a control group to indicatq vjhat would have occurred v;i*thout tfy treat- 
ment . It's as true in advertising as it is in drug research, where a 
"placebo" drug is always given to a control group. 
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The example above is the best way to refute the argument still hearc 
frequently in advertising circles that ''you can't really rr.easure the effects 
of advertising in the marketplace because you can't separate it fron all 
the other marketing forces." It's true that you cannot control or elirjnate 
all the non-advertising influences on sales--such as product quality, free 
publicity, 5 ':^n., word-of-r.cjth , a reservoir of good will, etc But 

the researcher can hold all those other forces consrr^nt and allow foV 
their effects ^ t:v^ use of tv;o things: randomization of treatments and 
the use of a control group. The use of the controlled experimental design 
does give a true measure o'ftfe incremental effects of any particular 
advertising treatment over and above other influences that may be operating. 
All experimen-rot ion--whether in psychology, medicine, or in any other 
field^-measur c -^rrental effects o"" the test trdatn^ent. 

To concl -k' t- .. analysis of . newspaper advertising Experiment, 
the ;jt.JVfous summary' is reduced to a still smaller table: 

Net Chori.,o in ::ales 
vn ti^ nq Treatment " Due to Advertising''' 

Campaign A: White-Teeth plus 1% 

Campaign B: Sweet-breath pltJS 11?- 

-(after subtracting control group change) 

it's obvious that campaign B is more effective in selling Sparkle-Dent 
toothpaste at this time. If, in additi^ to sales measurement, the 
researcher had simultaneously conducted sample surveys on awareness, in.or- 
. mation change, attitude change , and other consumer responses, he could 
obtain diagnostic data to clarify the reasons why the campaigns operated 
as they did. In short, by combining verbal response data with the 
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behavioral respdnse (sales), the researcher can determine both what 
happened and possibly why it happened. ^ 

Other CFX variations . The preceding example is just one application 
of this higKly flexible research plan. 

The independent or treatment variable in the example was 
" campaign themes .'^ What other independent variables could be used? To 
determine the optimum level of advertising expenditures , the following . 
treatments might be used: 50 per cent of normal, normal (control treat- 
ment), 200 per cent, 300 per cent and so on; several national advertisers 
have conducted experiments of this sort. Or the independent variable^ 
might be ^' different media" with treatments as follows: $100,000 in rad^o 
vs. the same amount Jn television vs. the same amount in n'ev/spapers vs. 
the same amount in direct mail, and on. Another independent variable 
might be " market s ize" in which one would set up separate treatments for 
large cities vs. medium-sized cities vs. small cities. One might also ^ 
experiment with vehicle treaj^weat : 20 full pages vs. ^0 half-pages vs. 
80 quarter -pages ; vehicle expenditure by contrasting effects of ^0 pages 
vs. 30 pages vs. 20 pages vs. 10 pages. In short, the independent variable 
in controlled field experiments is limited only by the number of message, 
media, money and market variations or "causes" that raise questions in 
the mind of the , adverti ser or his agency. The examples above do not^ nearly 
exhaust the possibilities. 

The dependent variables and data collection methods, used in con- 
trolled field experiments are also ouite flexible. In the preceding- 
example, sales was chosen; sales might be measured by store addits, 
pantry inventories, sgIos registration data or other means. Other 
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behavioral dependent variables that Tilght be used are: visits to retail 
dealers, coupon ^returns . requests for deronstrat ions and so on. Sa^iple 
surveys might be employed to r.easurt^^ such cORinun i cat ion effects as aware- 
ness, knov;ledge, attitude, buying preference and so on. In short, almost 
any sort of dependent variable (except possibly phys i olog i ca 1 responses) 
can be measured in a controlled field experiment; the nature of the adver- 
tised product, product uses and advertising goals should be the principal 
determining factors as to which of the many dependent variables should be 
chosen for measurement. 

Experimental designs of other sorts are pbss i b i ci, i n ^control 1 ed field 
experiments. The previous example v-.'as the ''classic'^ controlled experiment 
in which only one independent variable is used--the before-and^af ter-wi t h- 
cont rol des i gn . 

The basic c6n<!:epts of other designs are relatively simple. - In th'e . 
f actc r i al d es i gg , the effects of two or more independent variables and' 
their interactions with each other can be determined; for example, dif- 
fcrent levels of expenditure in different media has been tht3 subject of 
experimentation by Ford and DuPont. The latin square design permits' 
evaluation of the influence of three different variables at once, but 
cannot measure interaction between those variables; it is simpler but less 
informative than the factorial design. There "are many other sorts of 
experimental des i gns-rc rossover , randomized blocks, and so on. The point 

■V 

is^ control^fed field experiments lend themselves te any sort of experimen- 
tal design to measure either simple or complex effects. 

CFX te s t units . Controlled field experiments may also be classified 
according to the test unit which is manipulated. Three of these types 
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are the "test marltet" technique, the "split-run" technique, and t?ie 
"checkerboard" technique. » 

The test-narket technique is illustrated by the example used earlier. 

. T 

A group of cities or markets .are selected, then the mdividual markets ere 
randomly assigned to the various treatnients. The test unit whicn was 
randomi.zed is "r^arkets ' — hence the name, test market. Tne test markets 
ciiosen as jnits are usually non-contiguous, isolated -from each other and 
free from c^utside media influence. 

The s p] it- rt jr) technique uses individuals or individual househoidr> as ^ . 
the treatJT.ent units.. Starting from a listing of individuals, in^ tv.o- 
treatment experiment, every other person is des i gnated--AB AB AB A3 AB-- 
to form two randomized groups, A and B. V/hei e there are three treatments, 
every third person is designated — ABC ABC ABC— to form three randomized 
groups. A, B, and C; and soon for -any number-of treatment groups'. "The 
split-run technique is frequently used i n magaz i ne and nev;spaper. advert i s- 
ing researjth, where a complete listing of subscribers is available for a 
particular vehicle. It is also useful in direct-mail research, where nail- 
ing lists of particular kTnds of individuals are available; for example', 
an automobile advertiser mi^ht experiment v;ith two or more tr'eatments among 
Ford owners, among Chevrolet owners, among ministers, among teachers, or 
any other group for which a Irsting' is available. It has even been used 
i^ televisic.i, in those communities v/here a split-cable feed to alternate 
households from a community antenna is available. . ' 

The c^heckerbaard fec!)iiique uses areas within regions as the treatment 
units. A city or other market area can be laid out iti grids or, census 
tracts like a checkerboard, and these tracts can be randomly assigned to. 
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various treatments , one treatment per tract. The Mi Iwaukee Journal 
pioneered in developing a continuing research facility using the checker- 
board technique. , ^ 1 

, All three of these techniques are amenable' co advertisers wishing to 
experiment with two or more advertising treatmenuS. One variation v-^hich 
tan be used with any of them— at somewhat less cost-- is the "black-out" • 
advertisinc^ method. In an ongoing advertising campaign, after a sample 
of markets or individuals or tracts has been randomly divided into 
two groups, the advert i ser s impl y withholds or "blacks-out" the advcrcfsrng 
from one group which thereby becomes a coiiLiur ornnp. Sr.mot;m.jc tfio ^^^"^ 
in media co$ts -^a / offset the cost of the rese,arch. 

Values of CFX. The controlled field experiment is the only advertis- 
ing research plan which can measure .cau<:;c-oiid-ef feet relationships, 

^between advert i s i ng. and' i ts effects, in a real life situation. it is a 
relatively new technique and not many advertisers have used it extensively; 
the number of users is g row i ng , however , and it is signi f icant that some 
Of the' biggest and most sophisticated advertisers—Ford, DuPont , American 
Oil, and Scott Paper, among others— have been quick to adopt it. One 

. important point to remember is that control le'd field experiments can be 
used, in certain forms, by small advertisers as well as large ones. More 
will be heard about it in the years to come. 

Att i tude and I maqe_ Me jsu remen t ^ 

Attitude and image measurement is actually just one ingredient that 
may be used in many of the research pians ' descr i bed and is not, strictly 
speaking, itself a complete research plan. But because of its widespread 
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usage for all kinds of advertising research problems, It: is included here 
along with the other complete plans. 

Attitude and image measurement is used very frequently as an ingredi- 
ent of sample surveys , laboratory experiments, and controlled field 
experiments. 

«*' 

Definition of attitude. and image . The simplest definition of a 1 1 i t ud e 
is "a menta) or neural pred^pos i t ion to respond* favoraL r unfavorably 
toward some particular object." For most things with which a person is 
familiar, he has developed feelings of liking or disliking, for or against, 
favor or disfavor, in varying degrees. The simplest way to illustrate 
this is to have you rate your feelings tovjard the common objects 
(referents) in Figure 1. . 

Most people have no trouble assigning an attitude rating to any of 
the objects above, whether favorable, unfavorable or neutral. 

This exercise al so i 1 1 ust rates that people can have atti.tudes toward 
■physical objects (castor oil), toward people, toward abstract concepts 
(communism), toward organizations (Ford Motor Co.), toward consumer prod- 
ucts (Crest) ^ toward product advertising, toward a whole advertising 
medium, (televi si on) or toward a particular media "^ehicle ( Reader' s Digest ) . 

The attitude scale example reveals both tP^ d i rect ion and Intensity 

, ft 

of attitude but not the underlying reasons. For example, one's attitude 

^\ 

towai'd Volkswagen cars may be a resultant of many forces-^previou's exper- 
iei^cTe with the product, its relative preformance compared with other 
brands, visual impressions, the reactions of friends and family, early 
childhood impressions, and possibly advertising and other forms o^ mass 
communication., It should be noted that advertising is only one i the 
many influences on an attitude toward a product, 
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\ \ Figure 1 

ATT I TUOE QUESTIONNAIRE 

Indicate your feel ing toward each object by 
checking one response on each line beloWji ^ _ 
Nei ther 

Strongly Mildly ' like nor Mildly Strongly 

ATTITUDE OBJECT (REFE R ENT)^ 1 ike 1 ike disl ike d i s 1 i ke disJLike 

''Hard-rock" music . ...-.-^ 

Communism * - 

Spinach ■ 

Chocolate ice cream ^ 

Oogs , ' ' 

Sunsets ^ * 

Crest toothpaste , - ^ 

Country-wes tern music ^ 

Volkswagon cars , . ^ .^--^^ 

The U.S. President ^ 

Reader's Digest . . 

The Ford Motor Co. ' . ^'^ ' 

Television . / 

Carter Oil ■ 
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The/terrn ima ge refers to beliefs, reputation or ''perceived product 
attributes." The term is commonly used in many v;ays — the images of a 



pol 1 1 icaljcandi<^a^te, corporation image, product image and medi^ image 
are only a few. The primary concerns in advertising research are vnth the 
latter three. . 

A brand image is a set of beliefs about the attr ibutes or character* 
istics of a particular brand of product . It's the "mental descript ion" 
or profile of a brand/with a njimber of characteristics.. In the case of 
,a car, for example^ the salient characteristics on which the image is based 

might be: pickup^and getaway power, initial cost, maintenance and service 

/ • 

requi rements , ^appearance and styling, safety, riding comfort, trade-in / 

It 

v^ilue, dura^ality. (Those are some of the actual image traits used by 
one major/^utomobi le manufacturer in its continuing consumer surveys.) 
Figure 2^ shows hov; this is measured. 

/ • ■ . ■ . 

^ person's rating of a car on any particular image trait may or may 

not/be related to his att i tude toward the car; however, by analyzing brand 

irn4ge data, it's possible to get some ideas (i.e., hypotheses) about the* 

underlying reasons for favorable arid unfavorable att.itudes. This cah be 

illustrated by analyzing the attitudes and images of a particular car as 

determined by a consumer survey. 

In thi s' example, assume that a consumer survey of lOOC car-buying 

pr'ospects reveals that attitudes toward Volkswagen are distributed as 

f 6 1 1 ows : . 

Stror>gly 1 ike (210) 21?^ . 

,Mi Idly like (120) \1% 

Neutral (360) 36!^ ^ 

Mi Idly disl ike (l80) \Z% ' 

Strongly disl ike (130) MX 

TOTAL (1000) 100^ ; ' 
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Figure 2 
CAR IMAGE QUESTIONNAIRE 



Compared with other cars you might 
consider buying, how would you rate 
Volkswage n on the_q ua 1 i t i e s below? - 

Good pickup and getaway? 

Low initial cost? 

, Attractive appearance? 

Long-time durability? 

Economi ca 1 ope rat i on? 

Ease of handl i ng? 

Smooth ride? 

High trade-in value? 

Trouble-free maintenance? 

Ri.ght size for my needs? 



(Check one space each lin e V 
Above Below 
average Average average 
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To determine some underlying reasons for liking the Volkswagen, the 
researcher can break out the image data for just the 210 people who 
"strongly like" the Volkswagen. Table I shows the results of this cross- 
tabulation. 



TABLE I 

IMAGE PROFILE ASSOCIATED WITH FAVORABLE 
VW ATTITUDE 





Image, Rat i ng' D i str i but ion 
Amonq 210 *'FaVorable" People 




.Volkswagen Tral t 


Above 
Average 


J" 

Aveo^e 


. Belov; 
Average 


"Abdve"-"Below" 
Di f ference 


Good pickup and getaway 


20% 


55% - 


.25% ' 


■ 5- 


Low initial cost 


70 


15' 


15 


+55 


Attractive appearance 


■ 10 


30 


60 


-50 


Long-time durability 


ko 


30 , 


30 


-10. 


Economi ca 1 opera t i on 


' 80 


10 


10 


+70 . 


Ease of handl i ng 


60 


10 


30 


+30 


Smooth r i de 


30 


20 


' 50. 


-20 


High trade-in value 


20 


65 


15 


+ 5 


Trdluble-f ree maintenance 


: kO 


20 




.0 


Right. size for needs 


60 


30 




. +50 ■ 












The ''image prof i le" 


tabl e shows that , 


among people 


v;ith a favorabn 



attitude towards Vol ksv/agen , 20 per cent rated it above average on ''pickup 
and getav^y" while 25 per cent rated it be 1 ow 'average: ; tlie difference of 
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minus five per cent indicates that "pickup and getaway" is a mildly negative 
feature of the Volkswagen. But on "low ; n i t1 aV cost ," the difference of . . 
plus 55 per cent shows this is a highly positive feature. "Attractive 
appearance," on the other\)and, has a difference of minus 50 per cent, 
revealing this to be a highly negative feature of the Volkswagen. 

In summarizing this image data, we may conclude that some "reasons" 
for a favorable attitude toward V^<swagen are, in order, "economical 
operation" (+70), "low initial cost" (+55), "right size for needs" (+50), 
and "ease of handling" (+30). Furthermore, Volkswagen is, liked despite . 
some negative features such as "appearance" (-50) and "ride" (-20) ;i these 
may be , cal 1 ed -"un important reasons" for this particular group of people. 
Apparently, such features as "pickup and getaway," durability, trade-in 
vaiue and trouble-free maintenance are of neutral value. 

Those are the "reasons" for liking the Volkswagen!' A similar image 
analysis couldbe performed on the 130 people with unfavorable attitudes; by 
looking at thei strongly negative image ratings, their "reasons" for dis- 
liking Volkswagen could be determined. 

Thi3 example' of analyzing attitude and image ratings is only one way' 
of "massaging the data." It is rel at i vel y more simple (but possibly less 
revealing), than such complex statistical techniques as 'factor analysis, 
discriminant analysis, multiple regression analysis and the like, for which 
the use of a computer would be necessary. 

^ An imege profile consistin:; many beliefs about a brand^'will often, 
show a "halo ef f ect"--that is, a positive attitude toward^ a brand would 
produce many favorable bel iefs about the product image. 

The definitions of attitude and- image are summarized as follov^s. 
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. AlI i tudc is an overall favorable or unfavorable feeling toward a referent 
object (product, advertising mer^ium, company, etc.). The frnage of chat 
object is a set of beliefs about its characteristics. A person can per- 
ceive an infinite number of characteristics which go to make up on object^s 
fmage, but he is said to have only cne attitude toward it. An analysis of 
the image or beliefs associated with an attitude can be useful, in deter- 
mining tl^e .reasons why the attitude exi sts--negat i ve aspects to be corrected 
and overcome, positive aspects to be capi tal ized upon. Such analysis is 
particularly valuable in determining "selling ideas" or "propositions" to 
be used in advertising. It also is useful in product improvement, since 
no amount of advertising can. hope to overcome an unfavorable belief that 
is based on a truly bad characteristic of the product itself. 

Methods of attitude and image measurement. A brand's at^ttJtude and 

— - ^ — : ^ , 

image can be measuredby exactly the same methods. All the techniques 
that are described in the remainder of this section can be applied to both 
attitude and image measurement. Consumer surveys usually incorporate atti- 
tude and image measurement in th^ same quest ionna i re; s i nee on the surface ' 
they look the same, this often leads to confusion in analyzing the results. 

The remainder of this section will discuss attitude measurement only, 
for simplicity. But keep in mind that these are also tools for image 
measurement. ^ 

The three major ways of .expre.^;s i ng an at t i tude--verba 1 , , phys io log i ca 1 , 
and behavioral responses^-have already been described in some detail.^ 

The verbal response, as expressed in sample surveys — by personal inter- 
view, telephone, or mail questionnaire — is the most frequent method of . 
attitude measurement in advertising research, and will be discussed in 
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some detail here. (The chapter on message pre-testing will describe 
physiological attitude research techniques in more detai 1 . ) 

. There are many, many different techniques for the measurement of 
conscious verbally-expressed attitudes in surveys. These are. separated 
below into several general types--monad ic , relative preference, complex, 
and hierarchy scales. i 

\ 

Monadic attitude scales . Monadic refers to an absolute rating of one 
object at a time. For examplef'^Tti measuring ti;e. height of two people, 
John and Bill, monadic measurement requires independent measurement pf 
John's height (say, 73 inches) and Bill's height (say 70 inches). To 
observe only that "John, is taller- than BilT' is re 1 a t i ve mea s u remen t , to 
be discussed later. Several monadic scales are described below. 

The checkl i st is simply a listing of objects with the instruction to 

check those that are liked or agreed with. Here's an example: 

"Here's a list of different toothpaste brands. 
Put a check-mark beside those you like. You 
may check as few or as many as you like." 

Toothpaste brand Check those 

(attitude object) you^l i ke 
^ 

Colgate ( ) ' , 

Sparkle-Dent ( ) 

'Crest ■ ^ ( ) 

The dichotomous choice requires choosing one of two responses, like 
or dislike, for each of the objects 1 isted. . . ^ 
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Example: "Here's a list of different toothpaste brands* 
Beside each brand, indicate v/hether you like 
or dislike~fi5, by checking the appropriate box. 
Be sure you out one checkmark for each brand." 

'^ Toothpaste brand Check one 

, ^ LIKE DISLIKE 

\ 

Colgate *( ) ( ) 

Soarkle-Dent ( ' ) ( ) 

Crest ( ) ( ) 

The multiple chojce requires choosing one of three or more ca tegor^'i zed 

response expressing varying degrees of attitudel This type is frequently 

called "a verbal rating scale." ^ 

- "Here's a list of different toothpaste brands. Beside 
. each brand, indicate the degree to which you like or 
dislike it, by checking the appropriate box. Be " 
sure you put one checkmark beside each brand." 

• CHECK ONE FOR EACH BRAND 



Strongly Like Neither like Dislike Strongly 
^ Brand 1 ike - Mildly nor disl ike Mildly Disl ike 

Colgate 

Sparkle-Dent... ^ . 

Crest 



Ihe mul t i p le~choi ce rating scale can use many other descriptive. Verms 
and any number of degrees of attitude. One common usage \s si^mply: 
Excellent, very good, good, fair, poor. A nine-step verbal scale might 
take the form: Best of all,* like extremely,^ 1 ike quite a bit, i^kc 
moderately, neutral, dislike modera-tely, d i s 1 i ke ext reme 1 y , despise. 

The weM~known " Likert scale" is named after a prominent psycnol og i s t , 
Rensis Likert, and is v;idely used in basic communications research; to a 
series of controversial statements (rather than objects), the subject 
checks one of . fhese : Strongly agree, agree, ne i ther agree nor disagree, 
disagree, strongly disagree. 
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* The semantic differential is another wi de 1 y u«-*.ed technique in adver- 
tising. It is really an "eypanded dichotomy" with seven steps to allow 
for varying degrees of feeling. The results from several different scales 
may be combined to arrive at an overall aftitude score. 

Example: "Indicate your attitude toward each of the 
toothpaste brands, by marking all three 
scales for each brand. Be sure you rate 
each brand on all three scales." 



COLGATE TOOTHPASTE: 



Pleasanr.^ 
Tastes good^ 
Like 



/ 



SPARKLE-DENT TOOTHPASTE: Plfeasant_ 

Tasl^es good_^ 
V Like 



Unpleasant 
Tas,it6s bad 
DisI ike 

Unpl easant 
Tastes bad 
DisI ike 



Many variations of the semantic d i f f erent i a 1/ have been devised'^for 

use in advertising research. For example, the varying degrees of. attitude 

- ■ i 

might be presented in this fashion: . ' 



Like 



+3 



+2 



+ 1 , 



_r 



Neutral 



DisI ike 



Like 



Disl ike 



When numbers are attached to t^e seven steps of the semantic differeru- 
ti.l, it becomes a combinatiiM of verbal and numberical scaling--the 
numbers may run from +3 to -■3> or from 7 down to I . 
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With the semantic differential, as with other scales, the scale may 
run from 1 i ke-to-disi ike, or from d i s 1 i ke- to- 1 i ke ; where several scales * 
are used for each object, the sequence is usually alternated, to avoid 
stereotyped responses. 

The ^'calorimeter" is an expanded dichotomy with numbers attached, 

making it a combination of verbal and numerical scaling. 

Example: "For each of the three toothpaste brands named below, 
indicate your feeling by checking one box in the 
column below it." 





■ Colgate 


Sparkle-Dent 


Crest 




toothpaste 


toothpaste 


toothpaste 


Strong ly 1 i ke 


(+ 5) 


■ (+ 5). 


(+ 5) 




(+ 


(+ 


(+ 




(+ 3) 


(+ 3) 


. (+ 3) 




(+ 2) 


(+ 2) . 


, (+ 2) 




(+1) 


'. (+0 


(+ 1) 


Neutral 


(0) 


( 0) 


( 0) 




(- 0" 


0 


(- 1) 




(- 2) 


(- 2) 


{- 2) 




(- 3) 


(- 3) 


• (- 3) 




(- ^) 




(- k) 


Strongly disi ike 


(- 5) 


. (- 5) 


(- 5) 
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The numerical (or quantitative) scale is basically an arrangement of 
numbers, from low to high, indicating degree of feeling. 
Example : 

"At the left, you will see a thermometer rating 
scale, which indicates degrees of liking for a 
product. The highest possible rating is 100, 
the lowest possible rating is zero. Beside 
"each of, the brands of toothpaste shown at the 
right, plcas^ write i^ your rating, indicating 
now much you like itl You can write in any 
rating from zero to 100 for any brand," 

Wr i te in ' ^ 

Toot hpaste y o u r _r a t i nq 

Colgate 

Sparkle-Dent 



Crest 



It too can be called an expanded dichotomy, or a combination of 
verbal and numerical scaling, if verbal "anchor points" are added at the 
ends of the scale. ' . 

The variations on the numerical scale are almost endless. One method 
of^ empi'jas iz 1 ng negative ratings is to run the seal e from mi nus 100 to plus 
100, or .minus 50 to plus 50,. thus: 



-50 -AO -30 -20 -10 0 +10 ' +20 +30 +A0 +50 
] 1 — 1^) H _i „, , 1 , 



—.-100 like 

i 

1-90 

I 

.. !" 80 

- 70 

[ ^° 

! - 50 neutral 




- 30 

- 20 



- 10 

,1- — 0 d i s 1 i ke 
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Respondents are able to visualize numerical scales in telephone ' 
interviews as well as in personal or mail interviews. One ingenious 
telephone interview usage is the "telephone dial" scale. Respondents are 
instructed to look at the numbers on the dial, which run 1 , 2 , 3 , A , 5 , 6 , 7 , 8 ,9 
They are then given the na[Tie of a product and asked to rati? ;heir feelings 
according to the' telephone dial: "1 means strongly dislike, 9 means 
strdngly l ike", and so on. 

This concludes the discussign on monadic scales, with the final 
thought that these are only a few of the possible variations. The results 
f rpm al 1 these different kinds of scales are highly correlated with each 
other. In deci^ding which of them to use in a particular case, the degree 
of precision required may be the deciding factor or previous usage may 
be the deciding factor; everything else being equal, one should use scales 
that give comparable data to other studies. 'Ease of use by the respondent 
is also a very des i r.:«ble virtue. ' ' ' ^ ^ 

Relative preference scales . These att i tude rat i ngs involve relati^ve 
comparisons of one object with another, or with several others. 

The pai red comparison scale is widely used in advertising and marke^t- 

ing research. No^matter- how many brands are to grated, the respondent 

only. makes a comparison of- two at the time, until all poss i bl e pa i rS have 

been rated. > ' . ' 

Example: "! would like for you to evaluate three brands of 

toothpaste for me--Colgate; Sparkle-Dent and Crest. 

Tell me which one of each pair you like best .... 

Colgate or Sparkle-Dent? 

Colgate or'^Crest? > . 

Crest or Sparkle-Dent? 
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In surrmarizing the results of such a survey from a number o^ people, 
statistically computed percentages determine the final ranking of the 
three brands. One problem vnth this technique lies in the large number of 
pairs that result when the number of objects to be rated increases. V/ith 
three brands, there are only 3 pairs; with four bri^nds, 6 pairs; with 
five brands, 10 pairs; with six brands, 15 pairs, with seven brands, 21 
pair^; and so on. It's less time-consuming and le^s confusing to the 
respondent to use seven monadic scales than to use 21 paired comparisons. 

The ranking or "order-of-nier i t" nicthod is a way of getting relative 
preference judgements without going through a large number of paired com- 
parisons. With this method, the respondent is simply asked to rank the 
objects in order from first to last. 

Example: "i v;ould like your evaluation of three brands of 
toothpaste. Considering these three ^brands-- 
Colgate, Sparkle-Dent and Crest — whic^h one do 
you like bestV V/hich is your second ichoice? 
V/hich is your third choice?" j 

Mark 1 , 2 and 3 foj f i rst , 
second and t'hird choice 



Colgate 

I ' 

Sparkl e-Den t |_ 

/ 

C^est / 



This too can get confusing for the respondent when a' large number of 
objedt-5^are to be rated.* In personal i n tervli ews , th i s is handled by pre- 
senting the"^r.espondent with the entire list /of objects and letting him 
put the appropria"^t2^./anki ngs beside each onje (c> "self-administered" 
ques t i on) . 

One flaw in the ranking method is "hat no allowance is made for 



76 . 

different decrees of feel.ng between different rankings. For example, 
assume that a respondent rates Colgate, Sparkle-Dent and Crest as 1,2,3- in 
that order. His true feeling may be, however, that Colgate is a great 
deal better than Sparkle-Dent, and Sparkle-Dent is only slightly better 
than Crest. 

The constant-sum rating is one v;ay of indicating the magnitude of 

difference betv^een different rankings. This involves taking a certain set 

number of total "points" and asking the respondent to allocate any number 

of points to each of the di fferent' objects being evaluated. 

Example: "I'd like for you to evaluate your liking for 

three different brands of toothpaste. If you 

had a total of 10 points, how would you divide ^ 

them up among Colgate, Sparkle-Dent, and Crest? 

The more points you give, the better you like 

the brand." ^ 

i 

I 

Out of your totf-1 of^'^ten points, 
how many do you give.... 

Points 

Colgate? 

Sparkle-Dent? 

Crest? 

It's obvious that point al locations of 7, 3 and zero to three brands 
mean something qu i te i f ferent from 5, 3 and ^--even though the rankings 
are the same. . y 

One clever variation on this method is to substitute money for points- 
that is, the respondent is asked io divide up one dollar among the various 
• brands instead of theoretical "points." Sometirnes in^such a survey, the 
respondent is given a number of rea 1 . penn i es , or i.ickels> etc., with tsie 
names of the products spread out on cards; the respondent actually places 
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t'-^ money on each brand, depending on his evaluation of it. This v;ould 
seem to be a highly realistic method of obtaining true product attitudes. 

Both the monadic and the relative preference scale types are easy to 
construct without extensive preliminary research. 

Complex scales . These scales are not widely used in advertising 

research for ^ovoial reasons~-they require a great deal of preliminary 

re5e;^rch, they frequently requ i re,, rnnibe/ <;onie statistical analysis, ar.d 

thev ** ' ^'"^ ./oMi. M.*. ^ I .J. ? y [T?o/tT vdliJ than rhe^JinpJcr l>f>o<= .ij/env/y lH 

cussed. Three of the better-kfiown onc^—Tlutistnno, Gutttuan and Q-sort 

techniqi/e-wi 11 ho f ^r,m ^^H here briefly. All three were developed by 

poychologists for basic attitude research on non-advertising topics. 

The Thurstone Scal(^ or "method of cqnn 1 -oppcnr i ng intervals" is an 

n-step verbal scale consisting of whole statements which have intervals 

of equal numerical value in between. The respondent chooses the one state 

ment which best describes his .ntitude toward t ie test object. 

Example: "I'd like to find out how you feel about different 
"brands of toothpaste. From the 11 statements 
below, please mark the one that comes closest to 
your own attitude. ^ 

First of all, which statefnent best expresses your 
feeling toward Colgate toothpaste? 

Jyf somebody gave me some, I ' d g i ve it 

^' away just to get rid of it. 

' definitely dislike it. 

' v/ould have to force myself to use it. 

' would use it if no other v/as available. 

' ^ neither 1 ike nor disl ike it. 

't's OK but there are others I prefer. 

^t's better than most brands. 

' prefer it to all otheV brands, 

't's the only brand I would cons^^ider 

using; pt^rfect. 
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The scale above is a fictitious one, not developed from basic 
research. In a real Thurstone scale, the choice of statements is a very 
tedious process; they're not decided in grab-bag fashion from an armchair. 
The procedure in devising the scale runs someth i ng^ 1 i ke this: first, 
select a large numbet' of statements (somet imes ■ 200 or 300) representing 
all possible degrees of feeling toward an object:. These may come from 
consumer's free comments , what experts have said, content analysis of ads, 
anyvjh -re. Each of the, say, 200 statements is typed on a separate c^rd. 
A number of "expert" judges (researchers, copywriters, marketing people, 
psychologists, etc. )--as many as 50 to 100--is then selected. Each one 
is given the deck of 200 statement cards and told to sort them into piles 
ranging from no. 1 (least favorable) tono. 11 (most favorable) — any numbe 
of cards per pile. The average placement of each card by the fifty judges 
determines its location on the scale. Then 11 of the 200 statements are 
chosen, based on their statistical average and variability, to represent 
the 11 degrees of favorabi 1 i ty. These are then checked with a separate 
panel of expert judges, and if they hold up, only then are they ready for 
use in an attitude survey'. The development process is actually much n:ore 
tedious than described above, but this provides a rough idea. 

The Guttmon scale or "Cornell method" is theoret ica 1 1 y a very sounr^ 
process, but it too is extremely time-consuming and laborious. it is a 
"liierarchy" scale in the sense that anyone -endors i ng or agreeing v/ith a 
certain sea Id pos i t ion also agrees viith a lower scale position. 



79 



Example: 'M'd like to find out hovAyou feel about ' 
different brands of toothpaste. 

First, let's take Colgate. Beside each 
' . of the statements below, put a plus mark 

beside the highest position on the scale 
you v;ould endorse." 

'd buy it at $5 per tube, 
'd -buy it at $1 per tube, 
'd buy it at 50 cents per t . 
'd buy it at 10 cents per tube, 
'd take it if it were given to me. 



This is one form of "hierarchy" scale, meaning that the various steps 
form a ladder of successively more favorable attitude. If the highest 
price checked is the $1 price, the respondent would also buy at all lower 
prices; if the highest price a respondent was willing to pay v/as ^0 cents, 
he would not buy at any of *the higher prices, but wc'ild agree to take it 
at the lov;er position. The use of "price willing to pay" in the above 
example is only one possible way of measuring product* att i tudes by the 
Guttman method. 

This is knov^n as a "hierarchy" of responses--mean i ng that agreement 
v;ith any statement implies agreement with all the less favorable state- - 
ments and disagreenent v;ith all the more favorable statements. 

The development of the Guttman scale is so complex that no explanation 
will be attempted here. The theoretical concepts of un i dernens ional i ty and 
a hierarchy of responses argi useful, however, in understanding consumer) 
behavior. 

Q*sort technique of att'.itude measurement was developed by 
psychologist William Stephenson. Like the Thurstpne method, Q-sort uses 
statements arranged along an ll-step continuum. It diffe.5, however, in 
that the judges or respondents a fixed total nLtr- i^:' of statements 
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5i:ally ^8 or multiples thereof) and a fixed number prescribed for each 
of the' 11 steps. he purpose of this sorting is to force judgments into 
a ••normar* or "be 1-shaped" distribution which facilitates statistical 
analysis- 

When ^48 statements are used, the respondent is forced ^to sort them 



thus: 



Number of 
Pos 1 1 ion s tatemenu^ 

(Most favorable) No. 1 2 

No. 2 3 

No. 3 5 
k 5 

No. 5 6 

No. 6 6 
' No. 7 6 

No. 8 . 5 

No. 9 • 5 

No. 10 3 
(Most unfavorable) No. 112 

Example: 

."Here are A8 cards, each containing'a statement about 
toothpaste. I'd like you to use them to tell v^hat 
you think about COLGATE toothpaste. 

Now here is a sorting board with Jl poclCets. The 
left-hand side of the board is for statements that 
you think are most descriptive of Colgate, the far 
right position for statements that are least 
descriptive of Colgate. Please put tv-Jo statements 
on the far left, 3 in the next pocket (etc. through 
the various positions) '?'''>ri finally 2 in the far 
right pocket. 

Sort i nq Board 



No. of statements fo.r: each position 

Most like 2 3 55.6 6 6 5 3 2 Least like 
Colgate ^ _ Colgate. 

The respondent repeats the process for the other brands being rated. One 
coinpl^^xity of the Q-sort technique arises from the initial selection of 
^8 statements. These arq chosen from a larger pool of statements, much as 
in the Thurstone method. 
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A variation of the method lies in havino respcidents sort out a large 
number of brands or products into 11 piles, rather than sorting out ^8 
statements regarding one brand. (Fev; products, however, have ^8 brands 
which can be used.) 

ther, usage is in pre-testing ad headlines or sales propositions or 
themes. Forty-eight different ad headlines for a particular brand can 
be written, for example, and these sorted out into 11 piles along various 
dimensions: persuasive to non-persuasive, interesting to dull, etc. This 
usage more properly belongs in the pre-testing cfiapter, however. 

Hier archy scales. A hierarchy of attitudes, or product preference, 
V^has already been defined as a "ladder" of successively mor^favorable 

attitudes. The ,highest point on the hierarchy v/ith which you agree impl ier^ 
that , y\ would also agree v;ith or endorse all lower points on the ladder, 
and reject all higher points on the ladder. 

One such hierarchy, a "ladder of adoption of new products" is: 
awareness, i n terest , 'eval uat ion , trial, adoption. This theory, based on 
sociological research, postulates that people appear to go through a series 
of distinguishable stages in adopting a new idea or product--av/a renes^5 , 
interest, evaluation, trial and adoption. Av/a reness is the knowledge that 
a new idea, product or practice exists; i nterest is the active seeking of 
more information to determine its possible usefulness; evaluation is the 
weighing and sifting of that i nforinart ion , either mentally or jn discussions 
v/ith others; trial is the tentative trying of the product; adopt ion is the 
full-scale continuing integration of the product into attitudinal and 
buying processes. 

Psychologists have "postulated another chree-stage hierarchy of human 
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behavior — co^jnitlon, affection, and conation. Translated fron) the 
technical jargon, the theory is that people pass through successive 
stages of awareness and factual knowledge (cognition), favorable :titudes 
and feelings (affection), strong .-motivation or des i re for act »on 
(conation), possibly eventuating in the action ir:5e1f"in the^ case of 
advertising, purchase of the product. 

This illustrates another assumption of hierarchy scales or models-- 
that a person must pass t^hrough each stage of the process in order, without 
skipping any stages. 

A similar "ladder of product preference" developed by advertising 
practitioners is the Al DA hierarchy: attention, interest, desire and 
action- 

I 

One large a^CJtomobi le manufacturer has conducted continuing attitude 
surveys to determine, among other things, consumer position on a product 
preference ladder. The marketing process for any particuLir make of car 
is visualized as one of moving peopu: up the ladder from unawareness , to 
awareness , to "knowledge that the car-,n.TJk-a is in a pa rt i cul ar product 
class," to "consideration of the t^ake as among those makes you might buy," 
to "f i rst choice." - 

Another major automobile manufacturer has used a similar but simpler 

"buying probability" hierarchy based on consumer surveys. For the highest 

to lowest rung, it reads: -^.^^^^^ 

Would probably buy ^ / 

V/ould strongly consider 
Might consider 

Would definitely not consider 
Aware that it exists 

c 

The hierarchy scales have one principal distinction from the other 
kinds of sca'M^b discussed. A person's position on. tho scole*is not , ' 

90 



83 



determined by a single question in w;hich he checks one or more reL'ponses, 
Rather, a series of questicni is ^^k^d and a person's place in the hier- 
archy is determined by cross-tabulation of all the responses. This can 
be Illustrated in the case of the "buying probability'' scale by the , 
following survey questions: 

1. When you think of new automobiles, which 

make comes to mind first? 

2. What other makes come to your mind? 

3. If you were going to buy a new car today, 

which make would you probably buy? 
Vihat other makes would you want to shop 
before making a final decision? 
5. Which makes, if :i!v/, would you definitely 

not consider buying under any circumstances? 

In summarizing the results of the above questions to establish the 

distribution of consumers on the buying probability hierarchy, the data 

would be compiled In this way for each car make: 



Level of Hierarchy 
Awareness 

Definitely not consider 
Might consider 
Strongly consider 
" ProbabVy~buy 



Those persons naming Car X 
Q. 1 or 2 

Q. 1 or 2 and Q. 5 
. Q. 1 or 2 and NOT Q. 5 
.Q. 1 or 2 and Q. 3 or ^ 
1 or 2 and Q. 3 



Here*s how the responses to such a ^survey among persons identified as 
prospects, might be summarized in the case of three fictions competitive 
cars--the Constellation, the Chevalier, and the Mayflower. 



Z of all car prospects 




Make of Car 


Mayf 1 ower 


who .... 


Const . 


Cheva 1 ier 


(a.) Are aware 


85^0 


30% 


75% 


(b.) Vtould definitely not consider 




20 


ko ■ 


(c. ) Might consider 




70 


35 


(d.) Would strongly consider 


33 


50 


25 


(e.) Would probably buy 


25 


35 


15 
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is'oto th2 the pr.-Dortlon who fall into categories and c. add up 
to the I ,ar who are aware. Another category, not shown, is the "unav/are" 
group— 15'^, lOS, and 25% respectively for zhe three makes. The total for 
the three makes in category e. adds up to 75%— obvioL-sly 25^ of the pros- 
peers have named other makes. 

Hierarchy scales are not, strictly speaking, att:tude scales; they 

can i nco •^*-.e a number of dependent variables Effects ranging all the 

\ 

way from awareness to behavior reports, with th-e strict defir.rUon of a 
favorable attituc^e being only one "effect" that might be desirable. 

In concluding the discussion on hierarchy scales, it should be noted 
that the "hierarchy" theory has not been val idated— that is, no one has 
definitely established that everyone passes through the same stages up 
the ladder of product preference, nor that -theseare the crucial stages 
even if there a hierarchy. Like much other valuable marketing data, 
most advertisers would try to keep it secret even .if they had developed a 
valid scale. However, the concept is -exceedingly useful in analyzing 
-he marketing and advertising process arid should not be- d i scounted simply 
because it has not been thoroughly validated. In fact, very few i^-^as of 
tiuman iinowledge or measurement have been .thoroughly proven to everyone's 
satisfaction. . • 

Hierarchy scales are the only tools disc.issed here which are not 
suitable for image measurement. All the other=— monad i c scjles,, relative 
preference scales and complex scales--are equally applicable to both 
attitude and image measurement. * 

{ > ' • ^ 

Con' : " i'<led Observation 
^ Sometimes it is possible to set up a situation in which people are 
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watched without their knowledge while they view television, listen to 
radio, read newspaper and magazines, or perform other activities. Their 
reactions may be observed through a one-way mirror, which appears to the 



hidden cameras can record their reactions* Or someone in the same location 
can surreptitiously observe and record subject behavior while ostensibly, 
doing something else. Or hidden microphones can record comments, 

When a live observer z i;sed, his observations may range from impres- 
sionistic description of behavior to highly quantified ratings and pre- 
coded' categories* Filmed and recorded observations have the advantage of 
being all-inclusive and permanently available for analysis by several 
researchers. 

Observation, if properly controlled, has e advantage of being an 
"unobtrusive measure,*' not alerting the respondent that he is being "tested". 



This, of course, results in data that are uncontami nated by artificial 
testing conditions or verbal camouflage. 

Distinguishing characteristics . n.e research environment, the data 
collection method, and the response method are the principal distinguishing 
characteristics of this plan. 



res 




int to be a mirror but is transparent from the other side. Or 



Resc^^*ch environment: Stlmulu^ exposure, staged; response 

envi ronment , surrept i t lous 



Data collection method; personal recording and mechanical 

! recording of selected responses. 



Response method: 



Conversation, facial expressions, 
gestures, bbdi ly fnovement , focus of 
attention; spontaneous and unstructured. 
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Uses of controlled observation ^ One can, of course, observe responses 
to advertising in any situation where it naturally occurs. For most useful 
results, however, the stimulus exposure shoulci-be "staged" so that the. 
respondent is exposed to particular media or advertising of intercut to 
tne researcher but in an' envi ronment where the subject doesn^t suspect 
that he \s beiag deliberately exposed and observed- 
One example of such research is the clc-^sic " pcek-a-boo" study con- 
ducted by Curtis Publishing Company r?any years ago. Adults were invited 
to take part in an "eye test." After appearing at the designated address, 
each respondent was required to wait his turn for the "test" in a specially 
designed v/aiting room. The waiting room contalrred a comfortable chair, 

beside which)? was a magaz ine" rack and reading lomp — ^ehJ^d -the- choir, - 

unknown to the subject, was a one-way mirror; an observer watched thd 
subject without his knowledge. As the subject killed time by looking 
through the magazines, the observer was able to record which ads and maga- 
zine articles captured attention, the amount of time that was spent with 
each, and other reactions. In such a situation, certain effeicts of 
specially planted ads can be determined. 

The " candid cainera" technique is another application^ By staginc^ the 
kinds of ads or posters that are exposed to unknowing subjects In a fixed 
location, a hidden camera can make a record of their focus of attention, 
conversation, and other reactions. Dy planting a confederate on the scene 
to ask seemingly casual questions, more specific verbal responses can be 
obtained. / 4 

A device called the " Dynascope" has been used to measure attention to 
r.i'lcvisiou proQiciiMb dnd rniiitncrcf o J g . Tliis consists simply of a camera 
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riounted on top of a television set, to record attention t. programs and 
cor.mercials. This is not exactly surreptitious observation, but the 
reasoning is that after a while the viewers will tend to forget the pres- 
ence of the camera and react naturally. 

Another advertising researcher used graduate students as "spies" 
in v.:^ir ovjn homes to observe and record responses of family mer,bers to 
television programs and con-merc i al s . While ostensibly reading books and 
magazines, the students were actually watching and recording on pre- 
designed forms the reactions of their unsuspecting family. This technique 
has also been used to obtain behavioral reaction to newspapers and maga- 
zines . 

Another application of controlled observation is reported in a study 
and analysis of public conversations. The investigator simply stationed 
himself in rr^'ous public gathering pl-^ceb a<Ki , u^J. JcH tl-.c spontaneous 
comments of ..arsons nearby. The variety of topics covered by th. conver- 
sationalists, however, rarely included advertising and would haVdly ever 
include porticular advertising of interest to the researcher; one way to 
circumvent this problem is to plant particular advertising stimuli in 
hopes that the people nearby will notice and comment upon it. 

Controlled observation is applicable only for certain specific 
problems of advertising research. It does have advantages over many other 
plans, notably in that , subjects can be exposed an^ measured wi t.hout their 
knovjledge. 

Content Analysis 

The end product : creation of advertising is the advert . -e-ent 

itself. These physical products tai<e the'form of printed ads for 



nev;5pa:-'=irs , nagazines, odtdoor or direct mail media; for the broadcast 
media of radio and teleyision, the physical product rnay be permanently 
recorded on film, video-tape or sound recordings. This physical manifcsta 
tion of the »Tiessage--the resultant of all the creative effort, business 
planning and research •pre-testing--con be studied and analyzed for various 
purposes. f 

The method for such study is knov;n as content analysis. Content 
analysis is a research plan for the objective, systematic and quantitative 
description of the manifest content of advertising or other forms of .. 
communicat icn. The key words In this definition are objective, systematic 
quantitative and manifest, these v;ords distinguish scientific content 
ana lysi-s- from the ordinary inforn^l analysis of everyday life In watching 
television, listening to radio or'reading newspapers and magazines. 

Sy s temat i'c means tha t -the-^se 1 ect i on of advertising for analysis must' 

be based op a formal, predetermined, unbiased plan. Thl^^ insures that it 

will not be simply an argumentative, biased collection of data to prove a 

point. Q uant i tatlve . means that the results of the analyst are usually 

expressed numerically in some way — percentages;, ratios or more complv.x 

statistical suij^inaries . Results are more meanir>gful v^ihen one can say "The 

theme of * speed' was used in 30 per cent of Ford nev/spaper ads and in 

20 per cent of Chevrolet ads ' rather than the vague statement "Ford 

oppears to use the speed ihene more often than Chevrolet." Ob jective 

means that content ■ categories or codes for analysis have been defined 

,beforehand, and that these are defined so precisely that different coders 

would classify the content in the same v;ay. ' Manifest content refers to 

' 

those ad elements that can be acfually seen and counted rather than ' 
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reading "between the lines" for hidden mean i ngs--the denotative content 
-rather than any possible connotations of whai has been recorded. 

Pi 5t i ngu i shinq features . From this general discussion^ it will be 
gathered that content analysis differs in one crucial respect from other 
advertising research plans previously discussed; it is not human behavioral 
research," that is, the object under direct study \s advertising content 
itself, not the response of people to advertising. 

Data collection method: observation of content 
Design method: after-only 

Dependent variable: . any aspect of pictorial or verb'al 

or orgarf I zat iona 1 presentation 

Senpling: complete enumeration of population of 

ads, or." random sampling from 
^ prescribed vehicles and vehicle units". 

Uses of conten t ana lysis . The analysis of Dublished or broadcast > 
advertising has several research applications. 

There are certain general principles Oi corrmuni cat ion , learning, 
persuasion, .visual perception, readability and motivation whSch have been* 
reasonably well established through basic psychological research. A 
listing of these principles, together with a statement of advertising 
objectives, can be useful as a' guide to both the creati.on and evaluation 

of advertising. In pre-testing, the actual content of rough or finished 

\ 

4' . ' • 

ads can be checked aga i nst , these principles; where the, ads dor^M: fit the 

prescription, they can be iTiodified. 

Content analysis h&s several procedural advantages over other forms 

of advert i s i ng research. The basic research material, in the form of 

* ' ' ' '.'^ • • ' » 

-printed ads or recorded commercials, is readily available, permanent and 

... _ , 1- ^ 

doesn't require human subjects\^ Those factors** add up to savings in time 

V. . ■ 
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and money over other research methods. !t cannot serve as a -substitute 
for behavioral research, but it is a- useful adjunct sometimes when research 
with human subjects is impractical. ^ 

Readabt I i ty ancilys Is is one familiar form of content analysis. The" 
basic factors involved are , word 1 ength and .sente/ice length; it has been 
demonstrated that verbal messages using short words -and -short sentences 
are read more quickly, comprehended better and more likely to be read 
completely than the same' message using long sentences and long v;ords. 
- Rudolf Flescti h^s developed a formula for quickly analyzing and g'iving a 
numierical Readability score to wr^Uten materials. , • 

Various other formulas dealing with -other aspects of readabi I i tyfor 
example, the Gunning "Fog Index,'* Gillie's Abstraction Index and the Dale- 
Schall Index — have also been developed. 

Television scripts can also benefit from content analysis* The 
Dupont company^s advertising research department developed a coding system 
. based on psychological principles; content* analyses were used to make 

predictions of i:;f feet i veness and changes were'made if a script seemed to 
' be laQj<ing. ' - . 

^ome basic research and experimentation in print ad layout and design - 
^.has been c<?Rrfucted by the Aovertising Research Foundation and the HRB- 
^ Singer Company. This led to. the formulation of several layout principles 

for high "attenticn value" against which ads can be compared. The amoi;nt 

/ ■ 

of whita space> color "usage and other factors are Impcrtant ingredients 
which can be checked by content analysis. ^ - 

Another usage of content analysis is in the evaluation of competitive 

' . . . ^ r ' 

advertising. If there is reason to feel that\a competitor's newspaper . • 
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advertising has been unusuaHy successful, for exa'mple, content analysis of 

themes, persuasion strategies, choice of words, "or use of i llustraft ions 

and^color can ^produce some tentative conclusions on v;hy the advertising 
* A . 

was successful. <? . • 

Or an advertiser might analyze his own brand's advertising over a 

'certain period to determine if pre-determined advertising themes or 
other content goals have been met. ^ 

Another usage is/^to ccimpare high::\eadGrship .^ds and lov/-readersh 1 p 
ads'. If quantitative differences in content are found, the researchers 

'may concl ude— subject to further test- that the observed differences might ■ 
be. a cause^of the ^i f ference in effectiveness. (These 'Y-'OSsible causes'* 
are only hypotheses until verified by_ experimentation. ) 

' From the above discussion, it is seen that content analysis can be 

used in both pre-testing and post-testing messageSc It is no substitute 
for behavioral research, since it provides no direct evidence of advertis- 
ing's effects Ion people. But, combined with behavioral r'--search, itjzan 
help provide understanding of why ads have performed well or poorly. 
Additional discussion of content analysis is found i n ""the m.assage research 

. chapters . ^ \ _ ' 



99 



iV.' flEDlA RESEARCH 11: GENERAL 

An advertiser who allocates a certain amount of money for advertising 
is, quite natural iy, interested in getting the most for^ his money. Part 
of the advertising dollar goes ipto development of^messages, another part 
into the media which carry the messages; 

Determining the nost efficient .media is the primary function of Tiedia 
research- "to measure and compare 'different miedia and different vehicles in 
terms of vehicle distribution, vehicle exposure and advertising exposure. 
Media research must provide quantitative data from which objective deci- , 

o 

sions can be made. No advertising budget ever dev'i'sed-, even in the largest 

'•1* ^ " ' . 
corporation, would .permit u^e of more than a fraction of all the advertis- 
ing time and space avai labTe, ' Out pf^the innumerable combinations of 
media vehicles available, something more than, gue^swprk is needed t^ put 
together that particular ''media mix*' or "media schedule" .v/hich is^most 
efficient in reaching a product ' s target audience. 

What is media, or medi,a-vehi cl e\ eff ic'ien<ry? It is a function of , 
both the number of produ,ct-prospects reached and the cost of reaching 
them, A highly efficient vehicle is one v;hich reaches a 'great number of 
prospects at low cost. The usual measure of media efficiency is "cost- 
per-thoudand (CPM)." This can-be further specified in terms of (a) vehicle 
distribution as cost-per- thousand ci rcul at ion un i ts obtained, (b) vehicle 

exposure as cost-per-thousand prospects exposed to the vehicle, and 

' - f 

(c) advertisement exposure as cost-per-thousand prospects exposed to the 
Vehicle space carrying the advertisement. ^ 
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■ Quest ions Involved In Choosing Media 

Here- are some of the questions that occur to an advertiser at this 
point. 

Which of the med } a-- te 1 ev J s ion , radio, newspapers, outdoor, direct 
rpail, sk>^-/ri ting, matchbook covers7-are best for this particular product? 
Should the amount of advertising be spread equally among the chosen media, 
or should some get niore than others? How much more should the favored 
ones *^get? Should the advert is ing, appear simultaneously in the chosen 
rr.edia, or should the usage be alternated among them at diffeVent tirres? 

Assuming the amount for a given medium is decided upon, how should 
it be allotted among the many vehicles in that medium? In any particular 
vehicle, should the advertising be spread oat equally over time,"or 
bunched in some time periods and eliminated in others? Is it better to 
use many sm^J-^ads, or a few large "blockbusters"? 

All these are questions that must be resolved by rrcdia research. 

Typical Media Research Studies 

A good way to get the feel of media research is to look at the titles 
of some of the research studies already performed recently. Most of the 
studies reported below appeared in the Journal of Advertising Research , an 
official publication of the Advertising Research Foundation. 

Media research studies can deal v^Ith a single vehicle or a 
comparison of several vehicles, with a single medium or a comparison of 
several media, with vehicle "mix" studies or media mix studies, with 
media and vehicle "image" studies, and with reviews and discussions of 
advertising strategy and research methods. The unfaml 1 i ar terms should^ 
become known to you through studying this and the succeeding sections. 
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. '' SinqTe vehicle" studies are those which report on the effectiveness 
of one vehicle. Agostini*s article "Analysis of Magazine Accumulative.. 
Audi'ence" tells hovv the accumulative a,udience of sever^al successive issues 
of a^magaz'ine can be determined from knowing the audience size for -t^o - 
issues. Another Agostini article "The Case for Direct Questions on ,\ 
Reading Habits". was a comparison of two'met^ods for determining' how often 
a persop reads a part i cu 1 ar ' magaz i ne. . Bogart's article "The Impact of 
B'Tank Space: An -Exper iment in Advertising Readership" .tells Row the ^ 
readership of a newspaper advertisement is affected'^ by Tother 'mater ial 
appearing on thp same page, or the influence of "context." Engleman's 
article '.'An Empirical Formula for Aud ience ''Accumu 1 at ion" shows how the 
accumulated audience for 13 issues of a magazine can be estimated with a- 
simple formula. . , . . - 

It should be emphasized that most of the studies reported abcve,.and 
those that follow, are based on actual empirical research and are not 
merely speculations or armchair discussions; the essence of effective 
decision making lies^in the use of scientific evidence, and not in unsup- 
ported opinions. ^ 

" Multiple vehicle" studies report on compar i sons of several vehicles 
v/.ith each other, anc3 on the effectiveness of various combinations or 
"mixes" of vehicles.. Agostini *s article "-^How to Estimate Unduplicated 
Audiences" presents a formujo for estimating the combined audience of a 
magazi ne mix, from information about the individual magazines* audiences. 
Day's article "Linear Programming in\Media Selection" discusses the 
advantages and disadvantages of using a computer mathematical techniqu^ 
linear programming, in piclcing from a long list of vebicles those\few 
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that; v/M 1 . represent -the best mix for reach.Ing a desired audience. Dov/er's 
, article ''Uet Audiences of U.S. and Canadian Magazines" Is an additional 
. study to verify Agcst;n'i*s formula for estimating the size of unduplicated 
audiences 'for a particul^.r combination of magazines. Caffyn and Sagovsky' 
article "Net Audiences of British Newspapers" is another test of the same 
fo^rmula applied to newspapers, illustrating that both n'ewspapers and 
magazines can make use of the same research methods. (As will be illus- 
trated later, hov;ever, the print media and the broadcast media must use 
different research methods and measurements and this results in' some dif- 
ficulty in 'making a direct comparison betv/een them.) Garfinkle's article 
"A Marketing Approach to Media Selection" presents a method for comparing 
various vehicles inS^erms of the number of present customers and -pros- 
pective customers reached. Kuhn's article "Net Audiences of German 
Magazines" points up the importance of knowing how to determine the 
unduplicated or net audi ence-pf. a vehicle mix. Marc's article "Wet 
Audiences of French .Bus i ness Papers'* deal- with vehicles for specialized 
audiences rather than mass audiences. Corlett's article "The tPA 
National Readership 'study" shows how the audiences for 8O British nev;s- 
papers were determined in a s i ng 1 e- interview survey. Dudek's article 
"Relations Among Television Rating' Indices" tells how the value of dif- 
ferent televisi^on programs is dependent not only on^ the size of their 
audiences but ajso on how much they like the program, Massy's article 
"Discriminant Analysis of Audienci Characteristics" tells of a statistical 
technique for comparing vehicles, showing thalxsome vehicle mixes reach 

r 

the same persons whiJe others reach quite different segments of the public. 
There are fewer studies of a whole medium, or several media, than of 
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vehicles, for the simple reason that i t ' s^ d i f f i cul t to make -a single 
generalization that wiTl apply to the many diverse vehicles within any 
single medium. Research on media vehicles can thus be more precise than 
on v;hb1e media,, despite th'e need to know about the advantages and dis- 
advantages of advertising in the various, medi a . Ziff*s article "How t<^ 
Locate Purchasers of a Product" points out that to select the best media 
for advert/sing to current customers,' you have to know who those ^customers 
are and what media they use. Buchanan's artiicle "How Interest in the 
Product Affects Recall: Print Ads vs. Commer icals" compa^ed print and 
broadcast' media advertising effectiveness In terms of teaching product 
facts. Landis*' article "Exposure Probabilities as Measures of Media 
Audiences" reports on a measure of exposure designed to solve a knotty 
problem in mStiia research, the direct comparison of TV program and maga- ♦ 
zine audience slze.^ ^ 

" Media image"^ ' studies are aimed at determining how one's attitude 
toward, or image.of, a vehicle or medium can enhance the perception and 
communication value of a given message.' For example, Magaziipe A,..and * 
Magazine B may deliver the same number of advertising exposures for the 
same message among the same people,, but if Magazine A has a better reputa- 
tion for honesty, the ad space/may automatically deliver greater^ believ- 
ability for any message placed there. The attitudes toward or images of 
media are somet imes call ed "gual i tat i ve" variables to indicate that they 
have no precise numerical value,, Weilbacher's article 'The Qualitative 
Values .of Advertising MecJia" discusses several kinds of qualitativ.e value 
of a vehicle— audience characteristics, editorial personality, contribu- 
tion 'to advertising effect i-veness—3nd- evc-Cluates those qualities in terms 
of research techniques, media comparisons, vehicle comparisons, and. media 

' / 
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selection. ' Keissner' s article "Sales and Advertising of Lettuce" corriparss 
.the attitudes to^vard different media and the relationship of t-hose atri- 

tudes with sales. Kotler's article "Toward an Expl i ci t « HodeJ for Meiia 
.Selectibn" demonstrates a way to assign numerical values to qualitative 
_ image inTdrmation, so that.it can be figured in. with quantitative data In 

evaluating vehicles or media. 

Among the most valuable articles on media research are those that 

J 

deal v/I-th research fLethodology Such studies determine the validi.ty and 
practicality of differeiit research methods in obtaining accurate data. 
^Just as a watch must be an accurate instrumefit in measuring time, so anl 
advertising research tool must be an accurate "i nstrunent for its measure- 
-T-ent task. Cahala'h's article "Measuring NeV/spaper Readership by Telephone* 
compares telephone interviews with personal interviews as data-gathering 
methods fo^- determining^fnagazine vehicle audience size. Stock's article 
*'A Comparison of Eight Audience Estimates" compares the audience figures 
obtained with eight different kiiids'of questions relating to magazine 
readership. Copland's article "Some Fundamentals of Poster Audience 
Measurement" deals with theL peculiar problems involved in determining 
outdoor advertising exposure, and^..compares several different methods of 
measurement. Ki rsch and Banks' article "Program Types Defined by Factor 
Analysis" describes a statistical method for determining TV program types 
and the audiences -for those" typ^s. Henry's article "Belson's Studies in 
Readership" shov/s how the questionnaires and interviewing met+iods used in 
determining audiences of print media, can create large errors in the final 
figures. Allan's article "Photograph ing the TV ^Audience" illustrates oVe 
method foY^ determi n i ng the differe1)ce between circulation and audience of 



a TV cornrnerc I al , ttiiS study shov;inG that half the tirne no one was 

watching even though, the set was turned -on. Zangv^ilTs art Tele ''Media 

< 

Selection. by Decision Programming'* is a comparison of tv/o cornputer rnethods 
In determining vehicle mix audiences, ^^ 

After this^Frbad overview of 'the kinds 'of studies that go under the 
narr.e of media research, . i t ' s time to turn to the research rnethods used. 
The p/int media and tf\€ broadcast media will be considered separately, 
since sorrrewhat di^fferen't methods must often be used for each. 
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selection. Heissner's article "Sales and Advert i s ijig of Lettuce|^ conpsres 
^the attitudes toward different r.edia and tine reiat'onship of those atti- 
tudes vsfith. saies. Kotler' s article '^Toward an Explicit Model for Media 
Selection" derr.onst rates a way to assjgn nurr.ericai values to qualitative 
image information, so that it can be figured in'with quant i tat i^ve data in 
evaluating vchi c 1 es^cr -uied i a . 

Ainong -the most valuable articy^es on r;edia research are those that 
de^al \vith^ research rrrCthodoloqy > Such studies determine the validity and 
practicality of different resea rch jnethods in obtaining accurate data. 
Just as a watch must be an accurate instrument in measuring tiii^e, so an 
advertising resea rch- too 1 must b^ an accurate instrrument for its r.easure- 
ment task. Cahalan's article "Measuring Newspaper Readership by Telephone 
compares telephone interviews wi^fh personal interviews as data-qatlier i ng 
methods for determi ni ng jtiagaz : ne vehicle audience si-ze. Stock*s article 
"A Comparison of Eight Audience Estimates" compares the audience figures 
obtained with eight different kinds of question^: relat i ng »to. maga7 i ne 
readership. Copland's article "Some Fundamentals of Poster Audience 
Measurement" deals with the peculiar problems invol-ved in determining 
outdoor advertising exposure., and compares several different methods of 
measurement. KiVsch and Banks* article "Program Types Defined by Factor 
Analysis" describes a stdX i s t i Crtj 1 metliod for determining T'J program types 
and' the audiences for those types. Henry's article "Bclson's Studies in 
Readership" shows how the questionnaires and interviewing methods used in 
determining audiences of print media xan create large errors in the final 
figures. Allen'5 article "photographing the TV Audiencli" illustrates one 
method for determi n irig thf* difference betWeen circulation and audience of 
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Measuring Distribution of Print Media Vehicles 

No original research is needed to determine distribution, defined as 
the number of copies circulated. The Audit Bureau of Circulations (ABC) 
provides an actual coun?: of the pumber of copies of a newspaper or magarzine 
delivered under specific conditions. ' ABC was^founded to provicie assurance 
to 'advertisers that the circulation reported by a publication is accurate- 
Since the cost of print advertising is based on the number of copie in 
which an advertisement appears, this basic figure is important but doesn't 
go too far toward measuring vehicle effect i veness, ABC follows a very 
rigoroiJS bookkeeping and verification procedure to insure that a newspaper 
of magazine delivers the number of copies contracted for. The advertis- 
ing researcher can rest assured that circulation figures are accurate as 
reported by the ABC* No^ more need be said here about the methods used. 
Some fictitious figures for magazines and newspapers are given below: 

Magazine A Magazine B 

Cost, 1-page non-gplor ad, $35,000 $50,000* 

^ Circulation (No. of copies) 7,00C,000 10,000,000 

Circulation efficiency • 

(Cost per 1000 copies) . ' $5.00 . $5:00 

\\ 

The example above illustrates that,iwhile the total cost of an 
advertisement space may vary considerably from vehicle to vehicle. It Is 
generally pro^ortionaj to circulation within any given medium, and^the 
circulation cost-per- thousand will not' vary. foo much except under certain 
conditions of specialized audiences f)rfeferred treatment, etc. 
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Measuring Issue Audiences of Print Media Vehicles 

The research methods for measuring audience exposure are a^out the 

same for magazines and f*^ Consequently, this section will 

be primarily a discuss! ,ijdience research wi th the nrr- 

standing that the d i scuss i o^-l s rv,ally about both kinds of the major print 

media. The reason for th^is approach is two-fpld: more research has been 

published on magazines than new.spapers, and it is a good rfiental exercise 

for the beginning media researcher to take a given magazine example and 

think it through for a nev;spaper example. 

' 0Th^ principle variables to be measured for determining audience 

exposure to a magazine or newspaper are: 

. Audience siz e^: the number of persons reading the average 
issue, or total issue audience 

Audience composition : the kinds of persons in the issue 

audience, in terms of demographic cha racter i s I i cc 
such as age, sex, education, income, etc.; 
product buying and usage characteristics such 
as heavy users, average use(^., and non-users; 
other pertinent audience characteristics 

Amount. of a ud i ence exposure : the amount of issue exposure 
by individuals in the audi ence"-nuniber - 
of times the issue is picked up, the number 
of days it is^read, the number of items read 
I / and so on; alaip,, readership of different 

specific issues of a single magazine. 

How is such information obtained? The sample 'survey is the principal. 

method. Personal interview surveys , telephone surveys, and mairsu^veys 

have all been used for audience research. Under some c i rcumstancies one . 

method will be better than another,, under other ci rcumstances the .rnc-i 1 , 

telephon'e and personal methods are. equally good. Much methodological 

research has been d'evoted ;-to detennlnino vjUw.U ntiitKod^is b<?stf und^r what 

circumstances. - . . • 
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Planning and executing a media research survey involyes a great deal 



of painstaking attention ^^o the numerous uctails of surve^y procedure 
described earlier. The most crucial concerns in audience surveys are 
those of samp I i nq and question w r i t i ^a-'-the \nte validity of the data 

rest heavily on tl;ese two aspects of the pr ' re. 

Samp I i ng . The first step in sompling for media research is to def i ne 

the crucial population . The crucial population is dependent on the purpose 

of the' study. In a single-vehicle stVJdy (one magazine or one newspaper), j 

the crucial population is ''all persons in the circulation area who have 

read cjt least one is.sue'* in a specified time period; if a complete list 

of magazine buyer's names is available, it* may be a -elatively simple 

mattei^-^to draw a random sample of persons from that list. 

, On the other hand, in a multiple-vehi.cle- study in which the purpose 

is to determine the individual and overlapping audiences of a number of 

vehicles, the procedure is more complicated; the crucial population is 

defined as "all persons reading at least one issue of one magazi^ne on 

the list" in which case it is more practical to select a random, sample'^^of 

thecentire U.S. population, and use screening questions to weed out those 

who don't qualify as a reader. In the case of specialized magazines, 

such as those intended for physicians, a complete listing of this special / 

population may be available through a professional organization or a 'mail- 

list firm> In such a case, either single-vehicle or multiple-vehicle 

studies can utilize simple random sampl i ng from "the list. ' ' 

Again, in the case of a particular product whose buyers are known, 

the advertiser may define his crucial population as "all owners 'or users 

* 0 ■ 



of the product"; if a listing bf that popijiati'on is available, a simple 
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random' sample of those- persons can be drawn from, the list more easllythan 
from a sample of the entire population. In the case of a diaper manufac- 
turer,' for example, a listing of his crucial population of recent mothers 

may be obtainable; similarly, a truck manufacturer, can obtain a listing 

i' , 

ofCtruck owners for -veying the media habits of that crucial population. 

Most majo uci<. ies, however, are mul t i'ple-vehicle studies'of 

the entire'U.S. aduK .upulation, in which case listings ^of the crucial 
population are either unobtainable or inconvenient. Such studies are 
often sponsored and paid for by several advertisers, with the actual 

- : > . ■ , ' , 

research carried out by a commercial research firm. From these ".syndiT 
cated" studies ^ -separate tabulations of the results are then tailor-made 
for individual advertisers or media. 

For illustrative purposes, let's focus here on a personal interview , 
sample survey of theentire U.S. adult population, in which data on 
several magazines and on several products, are gathered. Assuming that a 
.completely random and representative sample of this population h^s been 
drav^/n, the validity of the questions becomes the crucial concern. 

Question writing . An operational definition of "a magazine reader'' 
must be arrived at before the pf*oper questions can be phrased. Is a 
'Veader" someone who (a) has seen the cover or (b) has riffled through the 
.pages or (c) has read at least one item, or (d) someone who usual I'y reads 
it, or (e) what? Def i n i ng readershi p i s ' a game any number can play, but, 
the usuaf definition of a r eader is someone who has at least looked into 
an issue . From this,* it'follows that magazine audience size is the number 
of people who look into the average issue . > Data from several issues is 
usually necessary to determine^the average issue. 

■ .. ■ '. Ill 
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Three general types of questions for dete,rm' n i ng reading behavior 

are unaided recal 1 a ided recall , and recognition. 

" Una ided recal 1" questions on issue reading are those v/here no clues 

are giveatT^and the respondent must rack his memory for the answer. An 

example of an unaided questioning sequence would be': 

fO P ever read any magazlni 

' magazines have you read :uring the last year? 

li A IS MENTIONED: Did you happen to see 

•the March 21st issue of "A"? 
(k) IF YES: Did. you happen to :1ook into it? 
.. (5) Can you remember what was on the cover? 
(6) Can you remember anything you saw in that issue? ' ■ 

Unaided questions 1-^ rely on the respondent's memoVy, willingness 

to think about a relatively Insignificant events desire to please the 

interviev;er and many other factors/which may lead to an answer_which is 

consciously or unconsciously distorted. Questiufs 5 and 6 attempt to get 

some factual verificaticn of the readership clain but these also leave 

doubts as to reliabillLy. :on you remember whc: s on the cover of the 

thi rd- r m-last issue of Time magazine, or some - specific inside that 

. • ** 

issue? ^ 

^' " Ai ded recal 1" questions^on issue reading give the respondent more 
information on the magazines i'^n questiVn and produce di fferent results. 
An exairiple of an aided questioo.ing se .;uence would be: 

(1) ' I'm going to read off the names af several 

magazines. As I name each one, please tell 
me' if you have seen any issue of it during 
the last year. (INTERVIEWER READS LIST OF 
MAGAZINE NAMES. TO RESPONDENT) 

(2) (FOR EACH MAGAZINE SEEN BY RESPONDENT, 
INTERVIEWER ASKS:) Did. you happen to see the 

" last issue of ^'A''? It had a picture of 
' on the cover? 

(3) Can yola remember anything. you saw or read in 
» ■ the i ssue? . 

112 
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Question 1 provides the respondent wi th specific ma5"azine names and 
produces more readership claims than the unaided sequence. Question 2 aids 

/ 

the refpbndent in visualizing a pa rt i cul ar. i ssue , and it would produce a, 
larger number of claims than the unaided sequence. Question 3 attempts-^ 
to verify reading of a particular issue by getting the respondent to 
recall (unaided) something he saw in tlie issue; such a quest ion' produces 
undere stimates of judi.ence sizej since It has been amply demonstrated that 
many known readers of an. issue can't recall anything in particular from 
• it-'-or can't be sure that something they recall re'ading came from a par-: 
ticular issue - 

■^'Recoqni t iqn^^' questions provide the respondent with even more informa- 

tion ^ me ■Jzine issues, by actually, showing him the logotype, or the cover 

or per^tTip's ^omr of the contehts of magazine issues. (The -ogotype is the 

sta'nr-aru: "^.rmr.t showing the magazine's name on every cover..) A recognition 

questioning ■ e::jence might run something like this: 

i' V) -re are. the logotypes of several., n^agazines . As '1 . 

now you each one^p 1 ease ' te 1 1 me i f you happen to . / , 

ive seen any issue of it during the last year. 
: (FOR EACH MAGAZINE MENTIONED BY RESPONDENT, INTERVIEWER ^ 
PRODUCES A PARTICULAR ISSUE OR ISSUES AND SAYS:) -Here ' 
is an issue of "A" that you may not have happened to 
read 'yet. Do you remember whether or not you have . 
looked into this particular ' ssu^TN Let ' s. 1 eaf through 
the first few articles to s-^^ ifwou recognize anything. 

-FTER LEAFING THROUGH PART jR ALl OF THE ISSUE, INTER- 
V EWER SAYS:.) Just for the 'ecord, now that we have 
bien through this issue, v/ou d you say you definitely 
happened to read it before, or didn't read it, or 
a ^en ' t you sure? " . ' 

Only I' persons who say definitely they remember reading the issue 

are coun: vt "n its aiudience. An additional technique for eliminating 

persons . > , aim issue reading falsely is the "confusion control" 

.technique ')everal dummy items that didn't actually appear in the issue 

113 
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are Inserted in the i ntervievyer * s copy; if the resporidcnt mi iitaken 1 y . 
claiips to have .seen the dummy items, he may be el iminated f rom the subse- 
quent tabulations or his responses might be given reduced weight in the 
overall tabulations, to allow for his "confusion" or exaggerated claims- 

The "recognition" technique for determining issue audiences is 
considered by many to be more accurate than either the unaided recall or 
aided recall techniques* It has been compared with other data from known 
issue readers and found to be a practical method for comparing the audience^ 
of several vehicles. However, much methodological research is still 
underway to produce more precise and accurate audience figures. 

Aud ience efficiency i 1 lustration. The audience for several Issues, 
is averaged to produce figures on "average issue audiente" to provide a 
more stable figure. V/ith data on average issue circulation and average 
issue audience, it's possible to make some additional judgments on vehicle 
value for the advertiser. Here's the previous example using circulation 
figures, with audience figure's added, and an audience efficiency computa- 
tion. "Efficiency," as in the previous example, is the cos t-per- thousand , 
abbreviated to^CPM, which makes it possible to compare an the same, basis 
different vehicles with varying circulation or audience or other measures. 

■ ■ , 

Magazine A Magazine B 

Cost, 1-page non-color ad * $35,000 $50,000 

Circulation (No. of copies) '7,000,000 10,000,000 

Circulation efficiency (CPM copie.s) '$5*00 $5.00^ 

Readers per copy (average) 3.36 ' ' . 2.50 

Issue audience (No. of readers) 23 ,500,00 0 25,000,000 . 

Audience efficiency (CPM readers) $1 .^9 $2.00 
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The example above shows Why audience figures are better for comparing 
magaiiines than are c.rculation figures. On the basis of circulation, one 
wou?d assume that Magazine A and Magazine B are equally efficient for the 
advertiser. But because Magazine A has more readers per copy, it produces- 
readers at a reduced cost-per-thousand — i.e., Magazine A is more efficient 
in terms that are meaningful to the advert i ser . 

Prospect audien ce eff! cjen cy i 1 1 u st rat ion . Even^ more important to 
the advertiser, however, is the number of p rospects for his product who are 
in the issue audience"; money invested in "advertising to people who are not 
current or future prospects for the product is wasted. 

The sample survey above,' in which the Jssue readership data were 
obtained, also obtained other data on demographTc characteristics (age, 
^sex, occupation, income, etc.) and on product buying and usage. This 
additional information can be used by advert ? sers to get an even better 
estimate of the efficiency of particular vehicles for particular products. 

This is illustrated betow by looking at the prospect audience for 
three advertisers: a soap powder, an airline, and a teenage pimple 
remq^dy . 

In the case of the soap powder product, the market or prospects are 
defined as '^femal e adult household heads*" For the airline;, prospects are 
defined as "adults between the ages of 25 and 60 who have ridden a commer^ 
cial airline in the last two years." For the pimple remedy, prospects are 
defined as " 1 3" 1 9-- yea r o 1 ds with allowances or incomes over $3 per week." 
(The prospect definitions were arrived at by previous surveys which 
correlated product buying with demographic characteristics.) 
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Magazine A Magazine B 



Ad cost ; 
Circulation 

Circulation efficiency (CPM copies) 

Total audience (average 1 ssue)' 
Audience efficiency (cPM readers) 

"^P POWDER PROSPECTS 



. jf total audience 
No. of prospects 
Prospects per copy 
Prospect audience efficiency 
* (CPM prosF/ects) 

AIRLINE PROSPECT? 



% of total audience 
No. of prospecrs 
Prospects per copy 
Prospect audi ennre efflcle 
(CPM prospects) 

P I MPLE REMEDY PRQSP>gtTS 




% of total, audienct 
No. of prospects 
Prospects per copy 
Prospect audience efficiency 
(CPM prospects) ' 



$35,000- 
7,000,000 
$5-00 

23,500,000 



25-5^ 
6,000,000 

.85 
• $5.83 



11.9% 
2,800,000 
.i»0 
$12.50 



33.7% 
9,100,000 
1.3 
$3.85 



$50,000 
10,000,000 
$5.00 



25,000 000 

$: 



$2.U0 



3'».3^ 
8,580,000 

.86 
$5.8'* 



31 ,0^ 
8,000,000 

.80 

$6.25 



20.0% 
5, 000; 000 

6.5 

$10.00 



The illustration above shows that Magazines A and B are equal'ly 
efficient: for reaching the soap powder rnarl<et. Magazine B is considerably 
more efficient for reaching the ai rl ine' market , $6.25 CPM vs. $12.50. 
.Magazine A is considerably more efficient for reaching the pimply-faced 
market, $3.85 CPM vs. $10.00.' / 

The mBjor points a-re that the prospect-audience is a more useful 
group for selecting media vehicles than the total audience , and that each 
vehicle mus— be evaluated in terms of its ef ficiency for a pa rticular" 
zsroduct . Ttiere is no such thing as "the best advertising vehicle" but 
only "best advertising ve^^;les for particular products." 
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^ In addition to ''total issue audience" which tells how many people 
have the opportunity for exposure to a single advertisement insertion in 
a single issue^ the advertinor Is also intt ed in tl' ^ cumu v£ 
audience' ' ior several ; ' =jc of Lhe smc publ ication, and the " undupl Seated 
a udience" for several different publications. 

Accumulative audi ence. Di f fere:-t i ssues of the same publication 
always exhibit some audience turnover. That is, of the people who read 
the June issue of a monthly publication, some will not read the July issue; 
and some persons who didn't read the June issue will read the Ju^ly issue.' 
The "audience turnover" varies from one magazine to another; this means 
that two magazines with an equal average issue audience may have different 
accumulative audiences over a period of time. Accumulative audience may 
be defined as the number of dt fferent people reached by two or more 

issues. \ 

\ 

Magazines A and C, bo^h aionthlies, have identical audience size for 
each month in the table below, and they have an identical average issue 
audience, but their accumulative audiences are quite different, 3^ million 
for A and 29 million for C. 





Magazine A 


Magazine C 


June audience 


2^ mill ion 


2^ mill ion 


July -audience 


23 rri 1 1 ion 


23 million 


August audience 


2^ mill ion 


2h mi 1 1 ion 


September audience 


23 mi 1 1 ic^^ 


23 mi 1 1 ion 


Total audience 


9^ mi 1 It on 


9^ mi 1 1 ion 


Average 1 ssue" 


23,500,000 


23,500,000 


Accumulative audience 


3^4,000,000 


29,000,000 




1.17 
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How COL 

Because Magazine . i :i 



:-3t dl f ferrjnce\ln "*Mativ( uj^M Mce occur? 
di^ce'''tur!icjver''-;'-that is, ^cwer people* 



drop out of and come into each suceeding issue. The accumulative audience 
Is the total number of people who _read any one or more of the four issues. 

Here's how- the 3^ million accumulative audience was obtained for 
Magazine A. , 

I. 

Magazine A Audience (in millions) 



I s^ue 



Old 



AcCumu 1 a- 
tive 



New 



Accumula- 
t i ve 



I ssue 



audience audience drop-outs sudlence audience 



June 
July 
August 
September 



2^ 

23 
2/» 

^3 



20 
2^ 
19 



6 
11 



2k 
3 
3 



2k 
27 
30 
Zk 



'•"Old audience" is defined as the number of this issue readers who 
have read at least one 'previous issue in the series. 

"Accumulative dropouts'* is defined as the number of this issue 
non- readers who/ have read at least one previous Issue in the series. 

"New audience" is^defined as the number of readers of this issue who 

r. 

have not read any previous issue in the series. 

An issue audience cbnsists of "old readers'* plus *'new readers." 
, The accumulative audience in any series' consists of the "old audience' 
plus the '^^accumulat ive dropouts" plus the "new. audience:" 

For June (the first issue of the series), there is no old audience 
and no accumulative dropouts, co/isequently the 2k million new readers = 
issue audience = accumulative audience. 

For July, there are 20 million old readers from June, A million drop- 
outs from June, and 3 million new readers. The July issue audience. is 
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thus 23 mil Hon, , The June-July accumulat i.ve audience is 20 million old 
plus k million dropouts plus 3 million new, for a total of 27 million.. 

For August, there are 21 million old readers from June-or-July , 
four million June dropouts and two million July dropouts (six million 
accumulative dropouts),* and three million new readers. The August issue 
audience is thus 2^Aniillion. The June-July-August accumulative audience 
is 21 million old plus 6 miUron accumulative dropouts plus 3 millt^n 

V 

nev/, for a" tbt^l of 30 million; . • 

The reader may test his understanding of this procedure by going 
through. the same process in'^arriving at the June through September accumu- 
lative audience of 3^ mi M ion. . . 

•In the table below, the au(;l'!ence information for Magazine A is com- 
pared directly with that from Magazine C to explain how the former has, a 
much larger accumulative audience. That is to say,*^A reache^s more ^ 
different people. . . ' . - ^ 









Audience 


in Mi 1 1 ions 












Magazine A 






Magazine C 






Old 


Drop 


Nev; Accum. 


■ Old 


Drop 


Mew 


Accum. 


1 sSLie 


aud . 


outs 


aud. 


aud . 


aud . ' 


out^ 


aud . 


aud . 


June 






2*1 


2k 






2k ■ 


2k 


July 


•20 


M 


3 


27 


22 




1 


25 


August 


21 


6 


3 ■ 


?o 


22 


3 


2- 


21 


Sept. 


19 


11 


k 




'■ ' 21 . 

s 


6 


.2 


23 


It's worth taking the time 


/ 

to master the simple 


arithmetic involved 



in this example in ord^r to understand ^the concept of accumul at i ve 

aud ience . ■ . 

This example will serve to illustrate two other concepts .^i^n media 

research, "reach'* and "frequency.'* 
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Reach. Reach is defined as th^ ^number of people reached, and it is 
identical to audience. Thus, the -reach of the individual issues, or of 
the average issue, is identical for Magazines A and C. However, Magazine A 
has greater reach than C i-f we' re .referr i ng to the total r^umber of people 
reached^with a series of four issues. ^ 

; * . . 

Frequency . Frec^uency refers to the number of times each person is 
reached. Thus, while Magazine A has greater accumulative reach\ Magazine C 
achieves greatf^r frequency. ^ This is illustrated in the table below.' 

June-September 1 ssues s 
M agazine A Magazine 8 

Average issue audience 23,500,000 23,500,000 

Total audience 9^,000,000 9^:, 000, 000 

Accumulative audience ' 3^,000,000 29,000,000 \^ 

, Frequency of reach 2.76 3.2^ 

This table shows that'the average reader in the Magazine A accumula- 
tive audience read 2.76 of the four, issues, while the average reader for 
Magazine C reads 3.2^ issues--that Is, his frequency of reading was 



yreater. 

This, raises the question as to which is more des i rable to the 
advertiser, reach or frequency? To use a simplified example, is it better 
to reach 100 million persons with one exposure each., or to reach 50 million 
persons with two exposures each? In each case, the total number of audience 
exposures is the same and assume the cost i.s the same. This in turn 
leads to the question, how n^y exposures are necessary for^^ advert is i ng 
to have an effect on a prospect? If one exposure is adequate to produce 
a sale, then reach is the desired measurement ; -however , if two exposures 

120 ' 
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are required to^produce a sa)e, then frequency becomes a crucial measurr.-. 
The truth is, no one really knows just how many exposures arc required to 
produce an effect; it probably varies for different kinds, of products and 
for lii f f&rent kinds of persons; This is one illustration of the ne'ed for 
bajic research which would discover the buyi.ng. probabi 1 i ties created by a < 
varying number of exposures to* product advertising. 

One pioneering study in this area was conducted by the S aturday 
Even i ng Post, to determine i f the second expo^aire to orl^ ad was less valuable 
or more valuable .than the first exposure.' A veryv-compl icated and ingen- 
ious controlled experiment was conducted which reveal ed - that the second 
exposure tj^y a person t*o a particular advertisement v*;as if anything even 
more effective than the first. However, a great deal njore of such research 
is needed to be able to assign a precise value to exposure, number 1,^ 
number, 2, number 3 and so on in ardeV to determine the required amoun<^ of 

repeat advertising to the same person to induce product- purchase . It is 

' . I. 

widely bel ieved, and probably true, that one advertisementjexposure is 
generally not very effective, and that prolonged campaigns^ are necessary 
to change attitudj^s and behavior. There i s no doubt, however, that wide 
reach--coverage of an audience with at least one advertising exposure — is 
at least a minimum necessary condition for advertising effectiveness, so 
reach is universally used as one meuHpd for determining advertising 
effectiveness, 

it should be remembered that reach is a measurement derived from 
vehicle audience .size, the size of the audience reached or covered by .oae^^ 
or more issues of one or more vehicles. 
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. Un dup 1 i ted aud i cnce , Undt>p 1 i c£<^ted audience j or .nefc^audiery^e, refers 
to the reach of several different vehicles. (the previous concept, 
accumulative ^udience, ref^^rs .to the reach of several issue? of the "Sarne • 
vehicle.) Foe any pair of national magazines, some of the same persons 
will 'read both and thus be *'dup 1 i cated" trie persons reading one or both of 

a pair of magazines are the undupljcated audience. It's obvious that when 

■ _ .» 

wide reach is the cri-terion for media sel ect ion^'^'Hen the objective is to 
select media combinations or "media mixes" that will provide the largest 
unduplicated audience: The example below wi 1 1 illustrate this point. 

{ . • ,^ ■ ■ ' • : , ^ - . 

Assume that you. wish to select, the best pair of magazi nes ^out of 
three available, Magazines D," & and F. All three. "(for the sake of sim- 
plicity in this e^xample) have the same average isjue audience, ten million 
'each. Which two will give the widest reach--i.e., unduplicated audience?* 
^ . Look first at the DH'pair. 'They reach altpost entirely the same people 
that is they have a high dupl i cated aud i ence , consequently a low undupli- 



cated audience, 



Readers ef D only 
( 1 mi I 1 i.on) 




Readers of E only 
(1 mi I 1 ion) 



Duplicated audience: 9 million" 



■ . ^ ■ 

■■ Now .look at' tlie PF pair.' They reach very few of the sa.ne people, 

that is ^hfey have a low dup] icated audience, consequently a high undupli- 
cated audience. 



V ) ) : 










Readers of F only: 
irmilTion)^""'^"^V V^/ /- , (3^1Jion) 



i ■■ ■ 

.Duplicated audience: 2 million 



The table belov^ sums up the results for the two pairs: 

Total Duplicated Undiiplicated 

■ Magazines audience audienpe audience - 

D + E 20 million 5 million 11 million 

D + F 20 million '2 million 18 million 

The DE magazine mix has an unduplicated audience of 11 million, DF 
counts 18 million. Obviously; DP is the better media mix in terms of 
unduplicTted audience. Equally clearly, magazine E's audience duplicates 
the audience for p and adds little to reach. ^ 
• .When a large advertiser vvants. to place advertising in several maga- 
zines to reach as many persons as possible, he thus loqks at them in terms 
of the undup.l icated or o of various mixes. Just as in the case 

of the', accumulative audience sever-l issues of a single pi Mcation, 

the.audience efficiency or cost-per- thousand-exposures can be computed for 



combinations of several rna^azi nes , by comparing 'the total cost with the 
unduplicated .audifsnce sizel . * 
^ .In a simple example such as'the one above involving only three maga- 
» zjnes, the computation is simple. " In actJality, hov/ever, choosing the 
best combination of five magazfnes from a list of 100 available can be- 
com|, rather complicated. 

Believe it or not, from a list' of 100 magazines , there are 
75,287,520 different f fve-magaz 'ne combinations. This has led'to the 
Increasing use of computers in media research, and the use of such statis- 
^ tical techniques; as linear programming, decision programming, incremental* 
analysis, algorithmic analysis and so on. There is not room here to- deal 
with all those complex techniques for determining unduplicated audience 
and cost efficiency for various mfedia mixes. However, the concepts of 
those techniques are easy to grasp from. the three-magazine example above. 

There is a. standard syndicated service available to advertisers which 
simplifies the job of selecting magazine combinations which wi fl maximize ' 
unduplicated audience^. The Starch Consumer Magazine Reports ', published 
annually and based upon amational survey of magazi ne' read ing, provides 
audience' data for 55 magazines and the unduplicated audiences for all pairs 
of those magazines. From knowledge of undupTicated audience of pat rs^ of 
magazines, various statistical procedures may be used to estimate. the 
coverage of 3*magazine, ^-magazine or larger combinations. 

Measuri ng j_ssue Exposures to Print Media Vehicles ' . 

. '-"^ «fc ■ ■ ^ ■' . 

Thus far, the discussion has dealt with the audience size, or total 

number of people expose le . icles as a basic measurement 

of advertising's poteni/ai ef t cct ii/efiess . An additionarl, consideration in 

- ^ 124 ■ ' . 
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evai uatfi nq 
exposes h 

For . 
of cost-|. 
audience 
only one e 
able to th 
ing expos 

This . 
both of v-7h 
efficiency. 



ov/ever, is the number of times a'pe~5on in the audience 

a vehicle unit, 
cake two magazines that are equally efficient in terms 
-"d-audience;- if one magazine is so interesting that each 

OSes himself twice to, each issue, while the other has 
r issue per reader, the former is probably more valu- 
er. Thus, the efficiency of two magazines in deliver- 
:e computed by an extension 6'f the former example. 

lustrated in the case of Magazine A -and Magazine G, 

the same circulation, audience size and audience 



Co- 



age non-color ad 
on 

er copy 
::ience 

per reader 
osures 

efficiency 
exposures) 



Magazine A 
^.$35,000 

7,ooovooo 

3.36 
23,500,000 

1 .0 



23,500,000 
$1.^9 



Maqaz i ne G 

$35,000 

7,000,000 
3.36 
23,500,000 

2.0 

^7,ooo>ooo 

. $ .75 



.It's ;us that, everything else being equal. Magazine G is 

probably a better advertising investment than Magazine A, since it pro- 
vides twice as many exposures for the same cost. 

This still leaves unanswered the question, "Just how valuable is the 
second exposure?" But it has, at. the very least, some additional value 
even though its exact magnitude^ hasn't been determined. 

Just the media researcher rfleasure the number^ of exposures 

of each a. lember to a magazine issue? The previous discuss on 

X 
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'■ 'isurement dealt v;ich the questioning "ocedure by whi;:^ rea:--ir- 

sr : an ssuc: is det. -rr'-^e.d. JireCt - jestion ij ' tne "r -.r^-qni tion' 

nie._:. xi: r determine t' rerso . no has looked n issue. 5ut can 

direc qu; ring re ve 5 1 > hovv ' ' - t i mes he looke: ? tc the ii-sue? Does 

the a\ : erson knov; now mc. ^ ti mes he has loo: inro a n^agazine copy 

the ;r.:V^ k n lying around .the house for several o or wer- .^7 

T lerr"! ly accepted a-^-wer is that di rect estionir ] i:n a conven- 

= :e survey p^^^be^bl^ :annot accurately r;v ^ now many times a 

. : jn -):: looked into an is.Tue. 

The ly accurate measL'renent possibl^^ is th ^ugh an extremely zor - 

p 3te:i ntrol led experimental procedure, in which different copies of 

t: .^a"~e sue are placed in a household on different days, v/ith several 

':-v f cervie /s among the s :~ie people.; The Saturday Evening Post/ was 

fi-M ; conduct such a study, under the belief that a "reading"' 

r T't: -e '.ch as the Post might :et more exp'a^f?ires per person- t>)an a "look 

-^r.a^z ' 2 such as L i fe . \7hile the whole measurenent process was 

extre 1/ complicated and expensive and conducted "among just a few people, 

e c ■ cc.jre v;as' someth i ng like this: 

First day:. Copy #1 of issue arrives in respondent's home 

Second day: Interviewer picks up Copy r'H and leaves 
Copy of same issue 

Third day: Interviev/er picks up Copy 1^2 and leaves Copy //3 

etc. 

T'.is ocedure was^ followed for several days. Instead of direct • 
questic" "eading, however, the experiments copies had been treated 

wi ch t. ' u;^ spots between c: in pages, r- or the "used" copies were 
picked w: possible .to ( ^ . : " ..: ' ne had been opened at 
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Measuring Advert isenienr Audiemces and Exposures i 'edia. V'ehicles 



The previous section dealt with audiences ard . res c* whole ) - 

issues of magazines and nev;spapers. Hoivever, exro:- an issu^e doe/n't 

[. ^ 

insure* exposure to tne advert! sing wi thi n the isiiue - - re viou sly noted, 
the media vehicle must take the respons^i bi ] i ty for -) --irm^rhe audfience 
tc specific advertisement space with?n an issue. A ' z?ne that is 
highly interesting throughout its pages, that cre;^. ? : ^vorable expec- 
tat ion among its audience, that uses layout and 'orrj c'^ectii ve 1 y ro lead 
the issue reader to every page, will probably prrzz-ze advertisement 
readers and exposures than wi 1 1 a magazine with : .■: issue audience 
but lesser **editoria] appeal." The abiJity to cr :e yert i s i ng exposures 
is what the advertiser seeks In a vehicle. Once . ,i <:^.icle has produced 
that- exposure , then the quality of the message der^:."-^ i ''■cs subsequent impact 
in terms of perception, commun icai ion and behavlc^od! response. 
% Remember that advertisement exposure doesn':: T^e- iari ly mean adver- 

tis^ement percept ion- -a person may have been expos^M: i:hoL:t conscsous 
awareness of the fact, without remember i,ng or charrrn p,.^: attitude as a 
result. Advertisement exposure- is simply the oppcr™:in:ty for a nr^^ssage 
to create perception and communication. 

The value of a vehicle that Ifi superior in cr:— :Inc ad v/ert i s i'ng 
exposure Is illustrated in the fol Towing example, d.^ efficiency cart" 
be computed just as in the previous examples. 

V 

Here, we will compare a fictitious '.'reading" -^^Ggarine (mostly text) 
.with a fictitious "looking" magazine (mostly "pi ctur^?:s) . rtt turins out 
the reading magazine has a fract ipna 1 advantage i n crevrti-rg additional 
advertising exposures, wh i ch. results in muc,h greete- ef ^"Icijency for the 
advertiser. 
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D Magazi-e ~ 

:;x t ( Mostly p ct :re s) 



Cost,";-pac i-,cn"Coli: 



$35,^ OC 



Cir3ul-tior • 7 ,OQC OC ... 

issue audier-..-. 23.; 0 23,50C OCO 

Averaqe ad pos-ir ; car reader „ ^ ^ 

• Totara:d £xrv.:sures JZ.?;' V :iO 25,350.000 

- ^ - ' COT 

Ad exposure .-ri:. -inr. '-^ v ^/ 

(CFM a a ..-poi ^ 

/ 

Tfte same questlc: fiat c.i^p'ied to the orev: sections on isiue 
exposure also apoly to ac ert i sement exposure. valuable are the ex 

ad expo - L; res, aird how r^on jne n.-^-^isure ad e>:r>o5- 

Recarding the val je af saccnd exposure, : 'fCL^ly cited Satur-dc 

Ever ing Post expcritnenr concluded that au seconc -c^jre is equally 
perhaps more vafuable than the first in creating ! rar:! familiarity a d 
awareness. Logic tells U5 that it certainly has : jre ac ditional .'alu-, 
even though the exact magnitude is difficuU tc n..as,ure. Because of "ne 
arti-^tciarnature of the controlled experiments, thus far, the latter :on- 
ciuson is prcoably the safest. 

A practi"::l method jr rreasuring adveri ng rroosiire in "he us^-:! 
-anpKe survey situation not yet been v:o- c t. Jr iy thrc r 
somewhat artificial condi -^--s of the "glue- DOt' -xr-rrnenta t ^iin. me 
have any vel ic measurcmer > cf^exposure beer obtair : t:-js far Neve- the- 
i:.^s.Sy that expcir inic'^'^a' l: -oach has conclusi e'v x '^str^tec -rh--::. rr-.qa- 
z nes do diffe:- in rneir itni iy to deliver -eeners tne adv.— t'se- 3 
'message. 

A study spon:;ored jc f'^':Oy by Reader's Dice ' ai Saturday Eve - - 
Post indicates that a r^or ::r, i y magazine issue. ; r^iidked. up more 
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dur '2 
de ve- 
th- 
ti- 



oncer 1 i f e t ' 
:re advert i semen': 



~g" magazines 



zsjres than "p 1 



vn']) t /.'^e 1 or bi--. •"•!<h' magazine and will 
^^x'T'-'^s ^-'{^s . \z also s ur: star t ^.ated zhe bel'ief 
p ' eke , up .TTore tiines and deliver more adver- 
manazi 165. * Thes^~ results are shown below: 



Reader - 
Pi qes 
(men tr 



text. 



•exposures 
readier 



u3.. oft 



5.0 
1.7 



Saturday 
Even ir g 
Post 
'eekl y , 
text) 



1.9 



re 



-ook 



- i y , (b i weekly, 
' cinral ) p i ctora 1 ) 



1 .H 



1.6 



1J 



cne first issue exposure, 
';as farther demonstrated 



Ab::.^:: *j3 of 'the ad cxpr>:s^:res took place 
the **smaindi£r on subsequent issue exposures. 
th^.- the nature of the adve sament itself^dic nor affect/ad_ex?:josure, 
zhuis ver^ -'inq thajt adv^Vt >:£^r.it exposure is nceeci ^ fu nction of the 
yer tele amd not the message ad exposures was ic^ni leal for color ads 
■and blaav-and-v^^hi te a r for ^jll-pa-^e ads and pair:— age ads; for appli- 
ances 3Lromotive, zl - "ood prou^ct and in:::.-^-Tce ads. (Differences 
'f'n tiv^ a£i-:^.ertis'inc -^i . "o s:tow up, nowever, rhe measurement of 
* ..i)dver'::z - per::epr - tc te c.:scussei. later.) 

Tr-i average r.r\' a' o: exposures rc an adv^M- : i'senu: " t in the Saturday 
£v:.^'r^': p-:)ct v^rle^d * "g to reader characteristics as follows: 
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^. -5^ 1.1 

and over 1 .2 

jOiTe :Z3 \ le^ge 1 . 3 

• . S . rr-aduate 1 . 6 

././•is an H.S. 1-3 

-la~:ied 1 ,5 

'iot married 1 . 3 



issue and advert sine ixpcsure also varied ..^t' certain oiher HcnHjyrGphJc 
a:ha-acteri sties such incorre, occ-jpation. gecgraphic rec^ion, ard so on. 

In summarv, ^you^-'^r^^ that-^ advert i i=emer t exposure is a valuabl 

concept, indic-zing ar important functrion cf the ertis-'ng vehicle tliat 
ihas been estab ished .ex.oermentel y , but n-,:^ rracti . r^-thod for recjlar 
r:{i:asurrer::ient yet been cevjsed. 

Measuring the -T-i l/ehic^^'s Cont r ib^jt icm 
to Advert i s emsr r " ^^arcept icrr: 

In previ ou- dii-cusis^^'^v- it: has oeen emp^'b5 i 2:^:' -net (a) '-he nrtsdia 
/e-^i cle r res: nsiole for >li^^irLlSL^X?Jr ^-ri^^ 5 su e acrd ' nee and 



exposiure^ anc dverti^jnc :;iidience and exposures , .nile (b) zhe qual t ty 
0^ the adverti::: ing mesj:^ro Jetermi nes ad vert is -i—g p ^^^R^.'lP^ and co minunica 
tion.. Research on the med a velii cle' s ^funct ' :*ns hai: been label led media 
reses ^Gh, whiHe research on the advert ' ^eirpn*: * s fur-r^ions is '.:-^tieci 

HcvweV^f^T, thoiTi -re .r'' ;^ fT kinds of jner-'^ raa-earch studies v;hich 
cnsc. 'e the app^-arentP sharp divisicn betwe^r" the vehicle' s and the mes- 
sage's contributions to overall advertising effectiveness- 

l3i • . ■■' 
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The fact, of the rrarter is, t^e v-^hicle can contri-jte to advertising 
percept i on net only fay prcvicing a larger base of expcsLires, but by having 
a reputation for bel i evab /* 1 i ty and oth'er quail ities, and by the context in 
whilch an ad appears. The differentia' value of tv;o magazines in creati'ng 
advertising perception (conscious awareness. of having be^n exposed to an 
ad) has beem' deiTnonst rated experimentally in the following way: an identi^- 
cal ad placed in, t^;o different magazin'c^-, witth condTtians controlled so as 
to produce identica' issue exposuire an:: ad e:Kposure., produced different 
recognition perception scores in the tw^o magazines. (ThFs vas a small- 
scale unpublished st^dy conducted by the Curtis Publishi^.g Conpany.) 

The /Advertising Research FoundatFon has 'cone 1 u^ded , afte ' a thorough 
investigation of the various mteasuires of media effect iveness , that a 
reliable methrod for mea^ p rinr^ the adverrlsing perception value, of diffar- 
ent media would provide rhe adverttiser wit:h a more use^o- rr^easure than the 
prevailing [jneasiiires of aL j^enes or ex:..0SLre- The 'ireth id o;f perception 
measurement has not yet b':ien worked out to reliably 3e;>'Virale the effect 
of the media vehicle fror the adve-'ti i nc message. Ho ver, two kinds of., 
studies are currently wl .i-Jy used give cl ues to the vivertising percep- 
tion value cf different rraedia, T'i^.ey are the reader tr^fflc (or item 
readership) / ^ - ano the media inaae SL-rvey, 

«^ 

Readc : • J"--^' J_c ''ur /ev_o_. In th- i.e-ne saimple survey r. wh i ch ' i ssue 
audience i leti-rmined, qu^st. i .jfiS can be rjoded to find ihe ' readership of 
Individual items in the issue. Us^ng the "recogni cic•^' riethcd, once a 
person has been verffiie^d as an 'Wssuje reader/* he car asked by the 
intervievi'er to look at tevery item iin the issue and incirate which of them 
has been seen or read. 

■ 1 '^'^ - 
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Sorr.e magaz.ines and newspapers conduct their own reader traffic surveys 
bjt most rely on the StarcK Readership Service and other syndicated con^tner- 
cici research services. - 

The questioning procedure goes something like this, though it may 

va ~ in slight details from one survey to another: 

(After the respondent is identified as an "issue reader/*) 
» , 

INTERVIEWER: As I turn the pages of this issue, please 

let me know v;hich Items you have at least 
seen before. 

RESPONDENT: (Pointing. to item) 1 remember seeing that ' 
one. 

JNTERVIEV/ER: (Pointing t« different parts of the ad) ^Did 
you happen to see this part (illustration)? 
This part (headline)? This pa rt . ( t radema rk) ? 
This part (printed copy)? How much of the 
copy did you read? 

From these, or similar questions, each ;:i(ivert i ^r.noMt t'n\i^ lor^iwpc; 
several scores: ' * ^ 

NOTED^OR SEENj The per cent of issue readers who say they 
had previously seen the advertisement in 
that particular magazine. 

' READ PART: The per cent of issue readers who indicate they 

~ have read at least part of the written copy in 

the ad. 

■o- 

R EAD MOST OR^ The per cent of issue readers who report 
READ ALL: < ■? reading more than half of the written copy. 

In additio-. to those principal scores, the per\^cent who say they have 

read each of *the various portions of the ad may be reported-^the per cent 

seeing the illustration, the per cent reading the caption, the per cent 

reading the trademark; thjs latter figure is reported by th^ Starch 

organization as SEEN/ASSOCIATED, meaning they saw the ad and associated it 
f 

with the name of the product. 
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The main p>erception scores, ho'we'/er, are the f^OTED scores and the 
,READ HOST scores. 

The NOTED score is generally interpreted as th^ attention value of 
the ad*s illustration, layout and general eye-catching properties. The 
READ MOST score is generally interpreted as a measure of the communi- 
cative properties of the ad, readjng.the copy bei/ig considered a necessary 
condition for learning or attitude change or behavioral effect. 

This recogr/ition method for meastjring the attention paid, or reader- 
ship of an adje rt i sement is a measure of advertising perception, not of 
communicat ion", j The knowledge of how many people saw or read an ad tells 
nothing about \yhether the ad had any effect on knowledge, attitude, or 
behavior. 

An advertiser m^ght use ad readership scores to test the perception- 
value of two different ve hicles . If the identical ad is placed In two 
different magazines at the same time, any difference in .readership score 



is clearvy due to differences in the vehicles. By determining the ratio 
between the readership score and audience or exposure data, a more precise 
estimate of pure percept ion value is obtained. Take the fol lowing, fi ct i'- 
lion*;, oyamplc of tv;o iii.^rja7 i n^*<; , in which the Gome advertisement was run 
at the same time: ■ 
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Ad cost 

C i rcul at i on 

I ssue Audience 

AD PERCEPTION 

% of issue audience 
. . .Who saw ad 
. . .Who read most 



No. of issue audience 
• • -^^ho saw ad 
. . .Who read most 

Cost efficiency 
CPM seeing ad 
CPM reading ad 



Maqaz ine A 

$35,000 
7.000,000 
23.500,000 



50>o 
10% 



11.750.000 
2,350,000 



Magazine H 

$35,000 
7.000,000 
19,000,000 



70^0 
16^ 



13,300,000 
3,200,000.^ 



$2.98 
$1A.8S 



$2,63 
$10.9^* 



Thus, while magazine A is more efficient in delivering issue audience, 
magazine M is more efficient in delivering advertising perceptions-, which, 
is after all what the advertiser is-more interested in: it matters little 
how large the issue audience is if the advertisement is not perceived. 

One may well ask at this point: How does one know that the respondent 
accurately reports the items he has seen or read, sinc^ with the item- 
recognition method of obtaining item rea.dership data there'is no verifica- 
tion of the respondent's report? Is it not possible that a respondent 
might exaggerate and claim attention* to more items than he has actually 
seen or read/ 

There is an experimental study whi^ch^nd icates that item readership 
scores obtained by the recognition method are accurate indications of what 
a pe.'5=on ha$ actually read. The recognition method, originated by George 
GaPup in the early 1930* s, had been in use for several years when the 
Cirtis Publishing Company decided it was time to establish its accuracy. 
\ ihey designed and executed what was called the "peek-a-boo" study. A 



135 



130 ■ 

number of persons (cne at a tine) v/aitinc in an office for an appofntrent 
were observed throtrgh a ^'one-way mirror" from directly behind their chair. 

(A '^Dne-way irirror" is one which appears to be a mirror from the respond- 

{ 

ent's'sfde, bur is transparent from the other side.) A magazine had been 
"planted** besiic-e th-3 chair in which the subjects were asked to- wait. 
While v/aitinc, . n::ost cf them leafed through the magazine, and an investi- 
gator observe- rhrough the dne-way mirror the items which the subjects 
stopped at an: the ex:tent to which each was apparently read. A record 
was kept of t items seen, those seerning^y read in part, and those' seem- 
ingly read en . rely. The subjects did not know they were being observed. 
Several days later, undeV the pretext of another purpose, the same sub-- 
jects v/ere questioned in their hOfies about a number of things, including 
their readership of items cn the test magazine. !t v/as found that their 
claimed reading of items, by the recognition method, closely matched 
th'eir actual observed reading behavior; a small number of people reported 
reading items they hadn't read, and an equal number reported not reading 
items which they had read; the net result was an accurate representation 
of item readership, since the tv;o kinds of errors cancelled each other out 

The Starch Readership Service publishes an annual ADNQKMS report. 
These figures are annual a^^gj^-ges for all magazine ads surveyed by the 
Starch organization. These are separated by: magazines Ir which the ads 
appeared; size of ad; different product categories; use of color; sex of 
respondent. Such average item readership scores provide "norms" against 
which indryfdual ads can be compared, and provide advertisers with rough 
estimates of the advertising perception value of various vehicles. A 
cost efficiency ratio is also reported , whi ch makes the vehicle comparison 
job easier. 
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' Media image studies . The ''qualitative value" of a'vehicle is . 
derived from those intangible aspects of a vehicle that presumably a.dd 
to its value to the reader and hence add a "halo effect" to any ad5 that 
appear in that vehicle. For example, a magazine v/ith a reputation for 
honesty and credibility ip its editorial content will presumably deliver 
added creclability for the advertising content, over and above sheer 
exposure , . " - 

It seems reasonable that, if two magazines have the same audience 
and exposure, the one that 'is more credible will , provide, a "climate" 
that wil'l result in g reate r -pe rsuas i ve effect for an advertisement. 
Qual i tati ve val ues are measured by media " image" stcid ies . 

Consequently; many surveys are conducted in which respondents . are 

asked to rate. or compare magazines on such qualities as: 

Attractive appearance 
Convenient to read ev/d carry 
■ Wr i t i ng sty le 
Nev; ideas . ' 

Thorough coverage 

Modern , and up-to-date • « 

Pleasurable to read '\ " 

. Personal i2?ed - • - 
St imul at i ng ' 
Fresh and imaginative . ^ 

Truthful and accurate ^ ^. 

Bel ievabi 1 i ty of ' advert i s i ng ' 
and so on - 

The methods for measuring media- vehicle "images" are the same as for 
.other kinds of attitude and i.mage measurement described, in an earlier 

chapte r. • ' 

The results of such. studies show clearly, that different magazines 
have clear-cut differences on various qualities; every publication has^ 
some^^qual ities on.which it is superior to other publications, and some on. 
which it IS inferior. The problem in eval uat i ng . such data is that no one 



knows which are important qualities and which are unimportant In contrib- 
uting to advertising effectiveness. 

Take the following example of two. magazines which were rated on 
various qualities in a sample survey, the maximum possible rating being 
100. . ♦ 



Average Rating 

Magazine P Magaz i ne Q 

Lively ^ 89 72 

Dynami c » 69 " ^2 ^ 

Courageous 70 55 

Timel y " . gT ' 62 " 

I nformat i ve . 90 75 

Enjoyable TS 90 

Intelligent « 90 90 

Authoritative 70 . 70 

Rel iable , 55 65 

Ethical 69 . 

Friendly 68 ^89 

Thorough 53 ^75 



Magazine P is seen as more lively, dynamic, courageous, timely and 
informative. Magazine Q is seen as more enjoyable, reliable, ethical, 
friendly and thorough. They are seen as equally intelligent and authorita- 
tive. The questi.on is: which magazine is better in terms of qualitative 
effects on the reader and the advertising? 

Since there is no way of knowing which of . these a^ref the more important 
qualities, little has been added to our knowledge on the effectiveness of 
each as an advertising vehicle. 

The interpretation of media image data is still a puzzle to advertis- 
■ ing^^esearchers. This explains to sbme extent why advertisers inust to a 
large extent still rely on clearly quantifiable data such as audience and 
issue exposu.re in evaluating media; while such data cjo not go'as far in. 
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measuring media effectiveness as one rtiight wish, they do provide 

unambiguous numerical data of>known usefulness and clear-cut interprets- 

I 

tion, - 



JU 



,Mi»ny of the coocepts Mcod In rcacdirch on tho print rriedia are appli- 

cable to. the broadcast media, radio and television. However, because of 
» ■ • ' * •) 

the di fferences in physical characteristics' and in the' commun I cat ions 
processes, the methods of measuring the concepts of print and br'oadcast 
advertising are different. The, next chapter deals witH the concepts and 
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CHAPTER VI. BROADCAST MEDIA RESEARCH METHODS 

Radio and television are the major broadcast media. In evaluating 

the i r effect iveness , the steps in the advertising process already dis- * 

cussed serve as a model : 

-Broadcast vehicle: a specific broadcast program (e.g. , the 
6-6:30 PM news program, the Lawrence Welk show, etc.) or 
time period 

-Vehicle unit: a particular instalment pf the broadcast 
vehicle,' or the average instalment 

-Distribution: the number of. sets tuned in to the average 

i nsta Iment of the f)rogram . ' 

-Program exposures:' the number of times each person is 

exposed to the pjogram, summed up for all persons in the 
program audience (Not as useful in broadcast as in print 
' media) • 

"Advertisement audience: Commercial audience ,' the number of ' ^ 
people exposed to a pa rt i c J 1 ar . comme rc i a 1 time-periodr 

-Advertisement exposure: the number of times a<^^erson is , 
' exposed to a commercial time period, summed np for all 
persons Mn the connmercial audience (Not as useful, in 
broadcast as in print media) * " 

Similar methods are used in both TV-and radio media research. Because 
more research has been conducted on TV tKis section will concentrate on 
televi s ion research, "wi th- the understanding that, except where noted, the 
same^ethods also applyto radio research. 

In some respects, broadcast media research is more complex than 
printed media research; i n other , respects , it is simpler. 

One complexity arrives in the .definition of a television vehicle . A 
magazine vehicle is clearly identifiable by name, is the same from one 
place to/another, has concrete physical units of distribution which can 
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be counted. T: sion vehicles however, ray be defined as different 
programs; or di'" -ent stations ; or ^di fferenc fretworks; or different time 
periods or in c: r ' ways. In practice, a television vehicle must be ^ 
defined as a block of time on'a television station or n etwo rk which can 
be purchased fo r adverti sing purposes . Thus, a TV. vehicle c5n range^all 
the v;ay from.a single 1 O^s,econd spot commercial on a -single local station 
to a 39"week series of one-hour programs appearing on all stations of a 
network. 

Another complexity of broadcast media research is in the measurement 
rprocess. A television message leaves, no p-zsicai tang i b 1 e t race that it 
has entered a Kc-usehol d. There is no material "countable" object which 
can serve as di-^e::! evidenz::^ ojf broadcast vehicle distribution, as con- 
trasted v;ith r-^e .:.:?-int media v/here physical vehicle units are received 
by the audienc . The "recognition" techniques for measuring print audi- 
ences are d-lff ' ' if not impossible for television, since an interviewer 
cannot usually /' a previously run program or cornmercial in obtaTining 

.audience and e> : e data. In cases where the sainc commercia'l appears 
many times on c ' i "^ent broadcast vehicles, there is great possibility of 
confusion rc^rin the sriecific vehicle unit on which the commercial was 

attended,. ' . . • 

In at least one respect, however, measurement of broadcast audiences 
is simpler than magazine, or newspaper audiences — and that's because of the 
single fixed reception time. A particular instalment of a program appears 

h ' • - . ■ 

only once, at a prescribed time, and there is no waiting to allow for it 
. to reach the total audience; the broadcastMS received at a particular . 
time pr not at al l as contrasted wi th a monthly magazi ne where a reader 

141 :• • ' • 



{ • ■■ ' ■ . ' . - ■■ ' 

; ' . 137 
may delay exposure for several days or weeks and accurate measurement 
requires allowance for a suitable delay in order to get accurate total 
audience data. Only rarely would a person be exposed more than once to a 
one-minute commercial time slot. ^' 

Because of the impermency and the fixed recept ioy--^^e of broadcast • 
vehicles, much broadcast media measuremer:?. is of the concurrent iiype; 
that is, measurement of distribution and S'<r<v; -ire is conducted simultane- 
ously, or a 1 most so, with the broadcast Ils^e : V/i th pr i n t med i a , 
measurement is retrospective ,, i .e/, meas:urerr;an: t^^kes piace after exposure 

■ The principva-l methods for obtaining rr cac f ratings are mechanical 
recording of sets in use, continuous diarfe'^ ci iewing behavior kept in 
the household, and coincidental i nterviev-.^s . Ea : ~ irf t^iese is discussed 
in same detail in the sections that follov/^ alo-: :.'ith» some other less- 
use^iii types, 

- Mechanical Re cording of B road cast Recept^ n 

"Nielsen rating" is a term knov/n TrT ci 1 most every household to mean 
the popularity of television and radio prog^^s* Nielsen ratings for 
programs are based on mechanical recordir.::!|^^^ set tuning with a gadget 
called an A'ydimeter. ■ \, 

' The Audimeter was developed and patented by the" A. C. Nielsen Company 
and was first used to' measure radio programs in 19^2. The Audiometer is a 
Small box-shaped electronic device connected to a TV or radio set in a 
household. 1 1 records the exact times when a set is turned on and off 
'and the stationCs) or channel (s) to v;hich the set was tuned during those 
times. The information is permanently recorded in a removable cartridge 
installed in the Audimeter; at specified periods, the household head 
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sends the used cartridge to Nielsen headquarters and inserts a new 
one. 

From the continuous record of set operatior provided by the Audimeter, 
one can determine v/hether and when the set was --ned before a particular 
■ program, whether the set was switched before a urogram ended and whether 
the set was tuned in during commercial periods. It can detect the flow 
into and out of any given time period or prograrr:,. 

As with many other forms of advertising research, Nielsen rating, ..re 
based on a sample of [J .S . households, the sample chosen to be as nearly 
representative of the total TVr-owning popularion as possible. The sample 
size' of about 120C meter houisnolds may seem small the non- 
re:,<:.archers , when proj jcted ri , esentativa of approxiuiately sixty 
^i\']\on U.S; househo 5. However the 1 aws , of s tat i st i ca 1 probability 
provide 95^- assurance that such p-ogram ratings are^accurate within about " 
3%' That is, a progra-n with a racing of 50^ based on a sample of 1200. , 
households almost certainly kSS% confidence) means that between ^7%' 
and S3Z of U.S. homes were tuned in. This "error" of plus or minus 3% 
could be reduced to about \% by using a sample or about seven thousand 
homes, hjt the increas'ed precision is not generally considered worth the 
six-fold increase in costs. " ' '\ 

One important poi nt to keep in mind regarding the "Nielsen rating^ ' 
is that it is a measu re of vehicle distribution or circulati cn and not 
a measu re of audience or exposure . It is a highly accurate measure of the 
number of sets turned on and tuned* in to a particular program, but it does 
not indicate how many persons, if any, are in the audience or actually 
exposed. A set' in use may have several persons paying attention, or 
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none. As such, the Nielsen rating corresponds to the number of copies of 
a magazine i 5sue_ c i rcul ated , not to- the audience of a magazine issue. In 
short, it is a precise n^easure of the first step in the advertising 
process — distribution--a ^ c only through the use of additional methods can 
the size of the bror^dca^: audience be detem: ed. 

Th-2 Nte-sen r'icures jre generally refe— *ad to as audience figures 
but it mur)": be ki^ot in mind that this is mer ly a convenience term, not 
cor respandirig to che precise definition of ^ liience (number of persons 
exposed) used - - s.^ nere.' That limitation mu.:: be kept in mind in discuss- 
ing three ser:^ ite program measures obta i nee from the national Nielsen TV 
rating figur. total audience, average' aud i 2nce and share of audience. 

The "Nieh en total aud i/ence" rating of a program is the number, and 
percentage, of 11 TV homes tuned in for at least six minutes. 

The "Niel£:n average aud.ience" rating is the average number of per- 
sons tuned in r r minute throughout the program, and is equivalent to the 
average number jf homes tuned in |through the whol e broadcast . 

The "Nielsen share of audience" rating is perhaps most important to 
the advertiser in determining the popularity of his program compared with 
oir i^i*iM|>of ; ng ptugiatiis nn th^ 311' at the same time. It is computed by 
dividing the p:-ogram's total audience by the tota 1 number of sets turned 
on at the same timig^,^^ 

The follo\%/ing fictitious example will clarify these three measures. 
The national ratings for all three^ networks during the 9-30"10:00 p.m. 
period on Thursday, June 17 are as follov/s: 
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Network 

ABC 
CBS 
NBC 
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Project ions from Nielsen Sample 
Total TV Households: 60,000,000 
9:3C-10 pni, June 17, sets-in-use: ^0,000,000 



Total ^>Audience" 
IMunoer Rat ing 

2Z,0GD,000 37% 
18,000,000 30". 
lA, 000,000 Z3% 



Combined 5^,000,000 90:^- 
Base 60^,000,000 100^ 



Avrerage "Audi ence" Share of "Audience" 

Number Rat ing Rat i ng 

15,000,000 25 (37/90) k]% 

13,000,000 22 (30/90) 33% 

12,000,000 20 (23/90) 22^ 

^0,000,000 67 " 

60,00O,C30 lOC; 5^,000,000 100^ 



Note that t^.e combined t otal "audience" Is 5^ ' ill ion, the combined 
averag e "audrence" is kO mi 1 Fi on. This is caused by some people 
Swi tcHi ng from ore network to another (for at leasts i^ix minutes with each) 
during the 9-30^no perioc and being, coar) ted twice ir total audience. 
The combined ave'rage auci snce must equal the total sets-in-use during 
the period, ^0 rr i 1 1 Ion. 



From these fictitious figures, 't is apparent chat average audience 
and total audience ratings give somev;hat d i f ferent. eval uat ions of the. 
programs. While NBC had the smallest total audience by far,, it was 
Successful in keeping vievvers tuned in for the whole program, or for long 
periods of the program, and therefore it nas a proportionately higher 
average audience. It's conceivable that one network might have the 
highest total audience and the Ic^west average audience, and vice versa. 

Average audience is almost always lower than total audience, though- 
a program which "hooked" all of its total audience to watch the entire 
program would have the same rating for total and for average audience. 

Despite its accuracy as a measure of distribution, the mechanical 
reception recorder has some disadvantages and limitations. It provides 
no audience or exposure data; the. mechan i caj devipe is subject to occa-^ 
sional malfunction; people forget to take out the. old cartridge and insert 
a new one; they sometimes neglect to mail in the used cartridge; installa- 
tion and servicing of the Audimeter may condition or "contaminate" the 
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normal viewing and listening ■ ••h.ivior of the householcl; permission must 
be 3ecure(;i to install the devices in the first place, and those households 
that agree may not be truly representative of those that refuse to take 
part. The latter point--5ecurf ng cooperation of a tru?y representative 
sample of househo 1 ds-- i s- p robab 1 y the'biggest single problem connected 
with mechanical reception recording. 

I ns tantaneous mechanical n-^asurement . One other problem associated 
v;ith mechanical devices Is .the oelay in reporting the results to the cen- 
'tral tabulation office-cartridges are genera, ly mailed in and replaced 
every tv/oy/eeks, with a correspondinr lag in reporting results to the 
advert i ser. ^. 

The desire for immediate information on x^rocr^rr^ reception has led to 
several variations on the mechanical measuremeTT*' rriithdd. 

A limited nunber of sets in metropolitan sr'::."- can" be connected by 
direct were to a (central poinr; set tuning is aeterred the instant it 
occurs and automatic tabulation r:a:ke5 it possible obta i n rat i ngs from 
a single city continuously, whi le a program is on ~"7e air. Reports from 
several cities can be combined, tabulated and re^rred vyithin a few hours ' 
after a program r^as left the air/ This centralized instantaneous measure- 
ment system has ihe advantages of speed and .quick detection of mechanical 
•malfunction; hovjever, reports can be obtained'only "'rom metropolitan areas 
with , no sample representation froTrr^imall towns 'or rural areas, and the 
cost is relatively high. Both Nielsen, vnth its "Instantaneous Audimeter,' 
and the American Research Bureau, with its "Arbitron," supply th ivs . serv^' ce . 

Mobi le. detect ion units are the nev/est vjrinkles in obtaining instan- 
taneous broadcast ratings. A truck loaded with electronic detection gear 



142 

can pick up electronic impulses while cruising the street^ and determine 
which sets in the vicinity are tuned to v/hich stations,, with the results 
being immediately and permanent 1 y recorded on tape. One such method, is 
an electronic Peeping Tom known as "TEST" (Tanner Electronic Survey Tabu- 
lation) demonstrated in Chicago. 

A news item also reported that airplanes can be similarly equipped 
with electronic detection gear'and gather TV rating data over a wide area 
qui ckly . 

Mot too much is known at present about^the validity of these mobile 
detect Ion methods , b,ut, they hold promise of overcoming some, limitations of 
other rating methods. ^ • * • 

Diary Records of Broadcast Reception 

A carefully kept diary of broadcast reception can provide data on 
both vehicle distribution and vehicle audience exposure . Both Nielsen'and 
the American Research' Bureau have a continuous panel of • d i a ry-keep i ng . 
households to suppl ement the mechanical measurement system.^ , . „ - 

A wel 1 -des igned diary record form wi IV contain. data an the name of • ^ 
the program, the station or channel , thq time and date of broadcast, and' 
the time spent watching the program by every member of the household. For . 
accuracy, the diary should be filled in s imu 1 taneous 1 y^ wi th recept ion, not 
delayed until the end of the day or later in^ the week. f\ mechanical device 
used by Nielsen to assure prompt diary entries consists of a light-and- 
buzzer system attached to the TV set which reminds the viewer every half- 
hour to fil 1 in his diary. 

Even so, the diary method has seve/al limitations which make it a 
supplementary device to the* mechan i ca 1 method and'nat an adequate 
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replacement. People forget to record what they have , heard or seen, par- 
ticularly in the case of radio listening which is accompanied by other 
competing Activity; shorter and less popular programs are likely to be 
igrrbred by the diary keeper while viewing of the most^ popular programs 
tends to be exaggerated in the record-keeping process; the households 
which agree to keep diaries may not be truly representative of those 
which refuse to cooperate; too much awareness^of the record-keeping 
process probabl'y distorts normal behavior to some extent; accurate record- 
ing becomes difficult when there is more than one radio or TV set in" the 
household. 

In spite of its limitations,, the diary method can provide data from 
people and places where the mechanical devices cannot be used, and it can 
provide valuable data on audience exposure and audience characteristics 
whi'ch is unobtainable otherwise. For this reason, the diary method is 
widely used as a supplement to the mechanical system. 

. All-media diary records . One of the principal problems involved in' 
comparing broadcast media, with print media is that different research 
methods are customarify used, and different criteria for circulation and 
• exposure are .necessary because of, the nature of the media themselves. One 
way out of this dilemma may lie in having a person keep a single diary in 
\ ^' which he would record exposure to all media — print and' broadcast-- i n a 
^ comparable manner. The Adv'e rt i s i ng Resea rch Foundation has evaluated a 
pilot study of 'this measurement method, the ARB-RKO study conducted in 
Detroit in 1965. Besides the comparison of different media obtained in 
the diary, this study also compares diary . data with that obtained by 
"telephone coincidental, telephone recall and personal interview methods, 
thus providing a valuable methodological comparison. . 
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Coincidental Telephone Interviews on Broodcast Reception 

An army of i nterviewisrs is scattered randomly around the U.S. /each 
of them continuously telephoning a randomly selected sample of telephone 
homes in his respective vicinity while TV and radio programs are in 
progress; that's a brief description of the coincidental interview tech- 
nique. It provides an average audience rating based on the program being 
seen or heard at the instant the call is made; by combining results from 
all over the country, an average minute-by-minute audience rating is 
obtained on every program on the air during the interviewing period. 

From this basic information, the share of average audience can also'"*^ 
be figured, along with data on the number and kinds of persons exposed in 
each household. 

Thus, the coincidental method provides measures of both distribution 
and audience exposure, but cannot provi de data on the total audience for a 
program nor on audience "flow" from program to program. . . 

Coincidental ratings were first provided by the Hooper survey company 
in 193^-'"as the well-known radio "Hooperat ipgs"--and since the advent of 
television a similar TV service has been furnished by Trendex. 

Some of the advantages of coincidental measurement of broadcast recep- 
tion are speedy tabulation and reporting, i nexpeps i ve' cost , avoidance'of . 

reliance on memory, almost universal telephone ownership, low interview 

- i 

refusal rate, and , no "conditioning" of the respondents by repeated data 
, col lection from the same people as in the case -of mechanical or diary 
methods . .* ! .> 

There are d i sadvaVitages of the telephone coincidental method: its 
inability to measurv^, total audience and audience flow; some undependabi 1 i ty 



in personal oral reports of program reception (including some exaggeration 
of. attendance) ; the problem of multiple receivers in the household; the 
necessity to keep the telephone interviews brief (usually about one ,i 

minute long); a growing proportion of unlisted telephone numbers. 

1 

The advantages of this method 'far outweigh its defi ciences , however , 

for certain kinds of program reception data. One particular usage for 

,. . . 

which, it is especi al ly .wel 1 suited is in quick .ratings of competitive 

network program popularity. Network TV executives are particularly inter- 

ested in the popularfty of their own programs compared with those 'of 

competing networks. In cities where all networks can be received, the 

relative popularity of a network program competing against other network 

programs can be quickly ascertained and ' tabul ated .- 

<i 

Other Ways for Measurijig Broadcast Re cept ion 

The preceding discussion on the three principal methods of broadcast 
-media research--mechan i cal recording^ diary> and coincidental telephones- 
accounts for the major part of such measurement. 8ut mention should also 
be made of other measurement methods used 5n broadcast media studies-- 
personal coinciflciiL.il , porauiiHl luctf^r recall, personal unaided recall, . 
I ) w^^/ioiu. iinai'UcJ recall, and various combinations of those methods. 

' Personal coin cidental r This is like the telephone coincidental ' 
method, except that face-to-face personal interviews are mads. Through- 
out a given program or time' pe<|od^ respondents are questioned about 
p rogrsm .exposure at the inomciiL the intei viewer arrived. 



*Pe^rson^" roster rec al 1 . In this aided recall method utilizing per- 
sonal interviews, respondents are shown a list of programs and stations 
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and asked to indicate which they were exposed to during a previous 
prescribed time span. 

Personal una i ded recal 1 , This differs from, the roster aided recall 
method only in that no list of programs or stations is, shown, depending 
entirely upon the unaided memory for exposure information. 

Telephone unaided recall . This is different from the personal unaided 
recall only in that the- interviews are conducted by telephone. 

Combination telephone coi nc i denta 1 -and- reca 1 1 . Respondents are asked 
in a telephone interview about both coincidental and previous broadcast 
exposure. 

Combi nation telephone co inc i denta 1 and diary . This method combines 
broadcast exposure information obtained by the coincidental telephone 
method in one sample of homes With i nf ormat i on obta i ned by the diary 
method in another sample of homes. « 

Combination telephone coi nci denta 1 and persona 1 roster recall . This 
method combines broadcast exposure information obtained by the telephone 
coincidental method in one sample of homes with information obtained by 
personal roster recall in another sample of homes. 

Combination mechanical recorder and diary . This combination is self- 
explanatory, using two different samples. 

Recommended Standards for Broadcast Media Research 

If the reader is confused at this point by the-grsat variety of 
methods for measuring program distribution and exposure, welcome to the 

• ■ 151 



' ]k7 

club. Some methods measurs one thing, some n>easure another/, when they do 
measure the same thing, they tend to give differefnt results because of the 
diffi^ring techniques employed.. Confused by the v/elter of conflicting 
results and techniques, broadcasting and advertising executives cooperated 

with the^Advert i s i ng Research Foundation in the 1950's to study the prob- 

J' 

\ 

lem and come up with some recommended standards against which the various 

\ 

methods coul d \h£L^yal uat ed . 

After intensive study, the ARF's Pxadio-TV Ratings Review Committee 
came up with a set of 22 ideal guidelines for broadcast media measurement- 
None of the methods previously described fills the v;hole prescript ion, " but 
some of them come closer than others. The seven principal recommendations 
are as fol lov;s : ' 

1 . Broadcast reception shou ld be measured in ter ms of set tuning 
(vehicle d i st r i'tmt ion or circulation), not in terms of persons exposed to 
the turned-on set (vehicle audience or exposure). V/hile it v/Quld be 
extremely desirable to know about actual attention to the set or audience 
exposure, no satisfactory v/ay of defining or measuring exposure has yet 
been formulated. Of all the various levels of exp9sure that could be used, 
set tuning or program circulation is the most objective, simplest and most 
understandable. 

2' The uni t of_ measurement should be the ho usehold , not the number 
of sets or numter of individuals. ''Mumber of households" has v/ider appli- 
cation for several reasons, though it is recognized that the number of 
sets does not equal the number of individuals. 

3. ' AJ 1 sets owned by the household should be me astjrpH , 
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4 • The entire reception area the stotiG -"(s ) cgrryfnq the program 
should be measured . 

5 . The measurement should be representative of all households v/ithin 
the rec ep tion area . 

6. The^ measurement should report the average instantaneous audience 
rather than tptal program audience. The average audience figure automat- 
ically weights households in proportion to the amount of time spent v/ith 
a program, permitting uniform comparisons of programs of different dura- 
tion. A total audience measurement, on the other hand, counts all house- 
holds equally regardless of how long they are exposed and for this reason 
is unsuitable for comparing programs of different duration. 

7. The measurement should express the number of ho'^useholds reac hed . 
Program measurement can be expressed either as numbers or as percentages 
of some total; because different bases may be used in calculating pei — 
centages, confusion in comparing different programs may result. Report- 
ing in terms of absolute numbers of househoTds tuned in eliminates this 
source. of variation. 

In addition to the seven principal recommendations above, represent- 
ing the basic information that should be reported in e^•ery broadcast media 
study, certain other data were recommended as supplementary Information. 
The following 15 Items, not to be regularly reported, pertain to useful 
but non-essential data on broadcast reception': 

8. Total household audience; 

9. UndupUcatcd houbenoid audience to two or more broadcasts; 

10. Program audience size meas.urements as percent of all households; 

11. Households using any receiver Dy 15~minute time periods; 



12. Audience cha racter 1 st i cs ^ such as sex, age, product usage, 

income , etc. ; 

13. PrograTn audience size measurements for specific segments of a 

program, such as commercials; 

]h. Full network audience*by specific tlr.e periods; 

15. Audience figures should be based upon a probability (random) 

sampl e ; 

16. Audience figures should be based upon the a'verage daily program; 

17. The measurement should be reported for each commercially sponsored 

segment of the broadcast--that is, each sponsor of a. multi- 
s^ponsor program should have audience information for his segment; 

18. All broadcast hours from 6:00 d.m. tcj midninht should be measured; 

19. The measurement should be available at varying frequencies, 

depending upon the iiTiportance of the market; 

20. The measurement should be av^^ilable within one month of the last 

measured broadcast- 

21. There should be adequate control of sampling errors, by rigorous 

specification of the design and size of samples--a random sample 
of ^00 is minimum for, local measurements, 1,200 for national 
measurements, during each IS'minute program period. 

22. The net effect of non^sajnp 1 i ng errors should not exceed the 

sampling erroi — non-sampling errors including such things as 
non-completion of sample, conditioning of tuning behavior, 
interviewer or reporting errors, and data-processing errors, 

I t has been mentioned before, but Ms worthy of reiteration, that 

every reference to broadcast audience above really means circulation or 

d i s t r i but ion of sets-tuned-in. This is one of the sources of confusion in 

media measu remen t-- the term "audience*' as used in broadcast media research 

doesn't mean the same thing *as when used in, print media research. The 

chapter on "The Advertising Process" is a useful reference to keep the 

distinctions between distribution and audience clear. 
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Evaluation of Different Measuremen " Methods {J 
Against Recorr.mended Standards 

Viith the seven principal standards of broadcast rredia measurement as 
guidelines, one c.n ozi:r:>are and evaluate the 11 principal methods. 

Only three of the re^thods^'- comb i na t i on-te i ephone-coi nc i denta 1 -and" 
di ary , comb I na t ion-tel ephone-co i nc i denta 1 ^and -persona 1 " roster- reca 1 1 and 
comb i nat ion- mechan i cal-and-d i ary — sat i sfy all seven standards for both 
radio and television media measurement. 

The deficiencies of the other methods are as follows: 



Me as u reinen t me t hod 
Di ary 

Personal roster recall 



Deficiency: Doesn't measure 
Average i nstantaneous aud i ence 
SafT^e as above 



Personal unaided recall Same as above 



Telephone recal 1 - 
Mechan i ca 1 recorder 

Persona 1 co i nc i dentai 

Combination tel-coin^ 
cidentai & tel- 
recall^ 

Te 1 -co i nc i denta 1 



Same as above 

All sets in househo) d--can ' t 
measure out-of-home sets in 
use (portable, car, etc. ) 

Same as above. . 



Same as above 
Same as above 



-(Telephone methods have an additional limiiatioh: they 
are representative of all households only to the extent 
that telephone ov;nership approaches saturation. ) 

It will be noted that no single method satisfies all cr i ter i a--onl y 

.the comljined methods provide all the data needed inadequate broadcast 

measurement. This illustrates a point that occurs '.ime and again in any 

• . ... I- , • 

form of advertising research--a variety of research methods and techniques 
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investigated. 

One other point should be made in closing out this chapter on broad- 
cast media research. The mob i I e-mechan i cal method is still in the develop 
mental stage at this v;riting; if it can be perfected, it could eliminate 
many of the problems associated v/ith the currently available methods of 
measuring broadcast distribution or circulation . This still leaves unre- 
solved, hov;ever, the problem of measuring individual audience members 
exposed Lo a broadcast — a problem for which there is no immediate 
prospect of solution. For the same reason, advertising exp osure Is an 
unknov/n quant iiy in bruancas L nicd i a research. 



( 
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CHAPTER VII. OUTDOOR MEDIA RESEARCH METHODS 

The principal forms of outdoor media are posters and car-cards , 

Po.'Lers are the familiar billboards seen mounted along streets and 
highways, scmetimes called "panels.'* Car-cards refer to the ads carried 
on the outside of buses and other public vehicles, sometimes called 
"outdoor transit posters" or "transportation advertisements." 

This is a relatively neglected medium from the standpoint of research. 
This 5s possibly due to the fact that outdoor advertising represents only 
one or two 'per cent of total advertising expenditures in this country. 

Bccausf^ of Lhc dearth of published outdoor media research studies, 
this discussion wt H necessarily be brief and confined' principal ly to 
posters. ' ^ . . 

Due to the peculiar phys i caT nature of the medium, outdoor research 
methods are somewhat different from those used in other media.. However, 
the familiar advertising process concepts of vehicle distribution, vehicle 
exposure and advertising exposure will be u^seful in understanding the 
basic principles of poster, measurement . . 

In the/^pos,ter medium, a vehicle may be considered as all poster 
locations (billboards, etc.) available for advertising purposes from a 
single poster firm within a single city or geographic area. (This may 
be compare)i vvi th the magazine medium; in which a vehicle js a single 
magazine, title, such as Reader/ s Di'gest or Saturday Evening Post .) 

y A poster vehicle or "buy" is generally available to advertisers in 
30-day segments, thus defining the veh i cl e un i t as a 30-day showing of 
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posters within a single geographic area. (in the nagazfne mediun, the 
vehicle unit is defined as one issue.) 

Vehicle distribution for posters is defined as the number of posters 
available or used in a given geographic area. In practice, this is trans- 
lated into the per cent of coverage of major traffic routes in an area. 
For example, a 'MOO showing" is the number of properly located posters 
required to establish complete 100% coverage of major traffic routes in an 
area; a "100 showing" in a large area such as Los Angeles might require 
^00 posters, whereas in a smaller area such as St. Louis only I50 posters 
might be required for ^ "100 showing." (In the magazine medium, vehicle 
distribution refers to the number of copies :irculatcd for a specific issue 
of a specific magazine.) 

Vehicle exposure for posters, ap in othir media, is defined as the 
number of people v^ho are known to have the oportuni ty. to see the poster. 
This means th^t anyone travelling along an apropriate route in the proper 
direction v;ho passes withip range of a poster showing is counted as a 
member of the vehicle audience , equi valent toone exposure. This is 
usua.lly translated into a percentage of the taal area population, yield- 
ing a "per cent coverage" figure. \ (Jn the magszine nedium, vehicle 
exposure is equivalent to the number of people who heve seen or looked 
into a copy of a particular issue.) 

TheTraffic Audit Bureau is a national research «rganization which 
provides reports on the number of people and number o* vehicles passing 
within' range of poster locations. This is useful advace information for 
the\ advert i ser , telling him the amount of exposure he expect to obtain 
with any size showing in a particular area. The Traffi Audit Bureau's 
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function for poster acvertising is qui te^'sini lar to that served by the 
Audit Bureau of Circulation (A3C) for the magazine and newspaper jiedi a ; 
one difference is that ABC provides data on vehicle di str ibution • (ci rcula- 
ticn) v/hile the TAB is concerned with vehicle exposure. 

One interesting difference in thfe poster advertising process, as 
compared with other media, is that poster vehicle exposure is the same es 
poster advertising exposure . The poster is both the message and the 
carrier of the message; it^s impossible to be exposed to one without being 
exposed to the other. This may be contrasted with TV and radio commercials 
wh^ch are only part , of tj larger vehicular context, or with magazine ^nd 
newspaper advertisements which are only part of a copy. \n both broadcast 
and print media, the audience pays deliberate attention to the vehicle out 
of persona] choice; In the case of posters, exposure to the vehicle and 
the advertisement is purely incidental, or accidental, to other purposes 
of the audience^ and this probably affects the way in which the message is 
perceived and cormiuni cates . 

l/hat methods are used for actually conduct i ng poster research on 
vehicle^di stribut ion and vehicle/advertising exposure? 

Post er d i s t r i but ion i s , of course, relatively easy to determine 
simply by driving along prescribed routes in an area and counting the 
number of poster locations. This is far simpler than for other* kinds of 
media and in" practice the po:>ter compofty recorcJb are generally accepted as 
correct, though some ver' f ication may occa's iona 1 ly be m^de by the adver- 
tiser or his agency. 

Poster exposure Hota is obtainable by four methods-'- the traffic-count, 
the travel survey, the i ormjn] t Ion ^u!vcy, and the pliotogrephi c survey. 
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The traffic-count survey of poster exposure Is conducted by counting 
the number of persons walking or riding ?n the proper direction past the 
poster locations. Previous studies have shown that- the mode of travel 
has a direct bearing on the probability of exposure; therefore, pedestrians 
and people in passenger cars are discounted 50 per cent to allov; for non- 
viewing, v;hile bus passengers are discounted 75 per cent. This sort of 
survey research gives ^reasonably accurate a/e-r'e. es': exposure 
by taking random sarpli-^ ^ u i « rr^e-of-cti / , jt random samplings of location 
along the different routes v;ithin an area, on different days of the week 
and at different seasons of the year. 

The table below, based on a Nielsen survey conducted in Los Angeles, 

shows the relationship between size of showing, number of/ posters, and 

poster exposure for different durations of shewing. 

r 

Los Angeles Poster '"xpcsure .. :i ' . ion 

Size v^l Mumber c^' Cumula tive undupll cated aud ir^ro 
show! ng posters After one week After ^onr weeks 



10 3^^, on 

15 57 ^9 77- 

I'j 107 

50 200 , 7b 

75 • 305 S7 

100 ^00 30 38 



• Note that the size of sliovsfing is directly related to the number of 
posters, except for minor variations in the smaller showings. It's also 
apparent that a given des i red coverage can be achieved with a small show- 
ing for a longer period of time or with a large showing: for a short period; 

I 

for example, SOZ coverage can be obta ned v/ith a No. 25 showing over a 
ftiin— "week period, or'v;ith a IJo. 100 snowing in one week. 
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One advantage of poster advertising is its ability to achieve almost 
complete coverage of a given area. A \lo. 100 shewing for four weeks dura- 
tion will be exposed to 93/3 of the adult population in the Los Angeles 
area. Probably no other s i ng 1 e adve rt i s i ng vehicle can approach this 
figure-'-not even the nev^spaper or magazine with the highest circulation ]n 
an area, nor t^ : highest rated television or radio program. On the other 
hand, the perception and communication rate' of posters I probably con- 
siderably lov;er for a given number of exposures than in the other media. 
An exposure, remember » bimplv means someone v;ithin range of a given 
vehicle. A certain amount of de-i iberate attention and motivation to per- 
ceive is present with nevjspapers, magazines, radiu and television. 
Attention to posters, on the other hand, is almost purely incidental and 
ncn-del iberarc, - other detracting feature about the cor/nun i cat i on power 
a poster Is iremely brief n^iure of 3xposure by passing traffic; 

the message must be briefer and m.ore immediately comp^'ohens ible than in 
the other media.. From the stanr' ioir* of research, th; :, ne^ps that recalK 
i'tormation ' , ^ug attitude chance from, a single exposure to a poster 
m.essage are very slight, result^ing in a krrotty problem for reliable 
research measu.ramient 

The travel survey m.ethod of measuring- poster exposure is accomplished 
by selecting a random sample of individuals in an area, then questioning 
them intensively on alT their local travelling, by foot or car, during the 
p^receding week. Since the location of all posters in the ar^a is also 
known, the journeys can be related to the poster locations and poster 
audiences estimated ther(3from. The travel survey relies on accurate 
sampling and is highly subject to mem.ory errors and is therefore a more 
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indirect, and less accurate rr.easurs cf exposure then the traffic survey. 
It does, however, pern:it gathering infcrratlon about respondent charscter- 
istics, and other interview-obtainable data. 

The recognition survey method operates by shcv/ing, to a sample of 
respondents in an area, reproductions of outdoor posters that have, 
appeared and asking which have been seen. An adjustnr.ent for mistaken 
" 'posure claims can be made by includirg some poster designs that have not 
cppeared :n the area. In practice, recognition data can be obtained simply 
by adding the appropriate poster reproductions and questions to a travel 
survey interview. U'-s difficult to determine whether a recognition 
survey is really measuring vehicle exposure^ advertising exposure or adver- 
tising perception; the same da;.a with variations, are used for all three 
measures. 

The photographic survey mctliod has not been used extensively, but 
.it is at least theoretically the best method of measuring p'oster exposure. 
One demonstration of this method was conducted by Alfred Pol i tz .Research . 
Cameras facing the highv/ay were concealed in a poster location and photo- 
graphs of passersby were taken automatically at selected time intervals. 
Special lighting and filters were required to'snap the night-time traffic. 
The photographic method has the advantage of not relying on respondent 
memory (as in the case of the travel survey) nor on the tallying accuracy 
of human, recorders (as in the traffic survey). However, the ^installation, 
maintenance and expense of camera equipment make this method prohibitive 
for all except special studies. 

^r^ JU jr. J, *t JU »U ^ • 

There has been even less research on car-card or transportation 
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advertising than on posters. However, In passing it should be mentioned 
that all four poster audience rneasurement methods — traffic survey, travel 
survey, recognition survey, and photographic survey — are equally well 
suited for measuring car-card audiences. 



CHAPTER VIII. K£SSAGE RESEARCH It] GENERAL 

The message itself is the final link in a chain of elements, all of 
which must be strong in order for advertising to be effective. 

Perhaps it will be helpful to repeat here som.e of the previous links 
and the choices based on research that should have already been rade prior 
to the message decisions. These! inks in the advertising chain include: 

1 . Market i product . lf«e product should be something for v/hich a 

9 

need exists in the marketplace; or, jn the case of a radically new kind 
of product; the public must be ''educated'* regarding their need for it. The, 
product must also be of sufficiently good quality relative to the other 
choices available to the public. The best ads/ertising cannot bring lasting 
succe ss to a poor product, or one for which no need exists . ^'Product 
research" also includes .v-^ork cn the product name, price, package and con- 
sumer motivations^ all* this is not, strictly speaking, advertising research 

though some of the informat ion developed in product research may be useful 

in planning advertising. * ' ^ ^ ^ 

i 2. Money for advertising .. Given a good and needed product*, too" 

little money for advertising can slow down sales, too much will result in 

financiaT waste. 

y. Media. As just* discussed In detail, this means choosing media 
and vehicles for maximum vehicle -di stribution, vehicle exposure, adverti^-* 
ing exposure and to some extent, advertising perception. 

k. The final step, Messages^. Tins roquiter. UolI. choice and execution 
of adve rt i s i ng m essages . In'terms of the advertising process model, mes- 
sage research is concerned v^'ith e-ntidncino .driver t i s i ng perception ond 
communication and certain behaviors, Lncluding purchase. •■ ■ 
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Message research includes both pre-testing (also called copy 

9 

research or creative research) and post-testing, for all varieties of 

'A 

media, in all stages of preparation from the ide^ or concept to the 
finished execution. 

How NOT to Determine Ad Effectiveness 

" Before going any further, a large dose of cold wa'^ter should be thrown 
,^ on one primitive but still popular method for judging advertisement effec- 
tiveness. ' " 
, Thi^ might be called the ''seat-of-the-pants'-' method. Sometimes it 
, takes the form of having an "expert" or critic to look through a batch of 
• ads or commercials and pass judgment. Sometimes, it takes on some psuedo- 
scientific trappings, as by getting the opinions of a group of experts 
who are asked to judge the quality of the advertising. 

Perhaps the best criticism of this method is provided by simply 
quoting from an expensive book entitled The Best Advertisements from 
Readers' D igest 1955-19SK Here are the author's comments on how he 
selected several dozen ads from 3,387 that had appeared In a seven-year 
■ period. - 

So that leads us to the question that started me 
writing this preface in the first' place: How did 
I pick "the ads in this book? 

When the assignment" began,. I sent a three-page 
letter to severa 1. hundrc^id advertising leaders 
outlining the project and asking for nominations. 

Several hundred exceedingly helpful repi ies 
resulted. You v/ould be interested,*^! think, in 
reading the lot. ., 

Most of my choices were also nominated by others^ 
so the book has a sol id core of almost unanimous 
professional opinion, unprejudiced and unbiac;^^^^ 
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I grew prouder and prouder of this adver- 
tising business as I read letter after 
letter in which my /'judges" paid no 
attention to whether or not their own 
compTanies had anything to do with the ads' 
they nominated. They just called them as 
they saw them. 

Other choices are mine alone, without 
benefit of readership figures, result 
stories or anything else beyond my more 
than forty years' experience as a working 
creative advertising man. 

While subjective judgments c is sort can be a useful guide to the 
technical production quality of ads, several basic research studies have 
been conducted that point to one overriding fact: Experts' i n any field 
don't see or evaluate things in the same way as the public . 'Art critics, 
drama critics, or advertising critics--al1 are.iooking and evaluating on 
different grounds than the public for whom the product is intended. Anothe 
crucial point is that any group of advertising experts will disagree among 
themselves when asked to choose the most effective advertisements from a 
larger batch. And there is no denying that a great many advert I sements--'^^ 
presumably having already passed the "test" of expert opinIon--are resound- 
ing failures \^hen circulated in the real world.. 

This is not to. say that creative skill and judgment of writers, . 
artists, and producers can be dispensed with — far from it. Biit it does 
indicate that the crucial test of advertising is whether it has the 
intended effect on consumers , usually the improvement- of attitudes or 
sales . 

Qui te of ten. an informed opinion is necessary; not every decision has 
Avidcnc^ available to backit up, and there is often not time to do 
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are many cases where research evidence is available, or can be obtained by 
sufficient forward planning, \7hen possible to use research, it is in- 
excusable to base highly expensive advertising decisions on anything other 
than the effects of the advertising on consumer behavior. 

The LXtcn t of Message R esearch in Advertising 

Farther on wi 1 1 be found a listing of typical studies in various 

\ 

aspects of message research. New methods and additional stildies are con- 
stantly in progress in advertising agencies, commercial firms and univer- 
sities. Most of these studies are never published, since tiiey deal with 
confidential matters paid for and used by clients. 

Most people may assume that all the treniendous flood of advert?se- 
ments in newspapers, magazines, radio and television are researched before 
being distributed. Such an assumption is largely wrong, even for the 
bi'jgest advertisers. VJhile almost all advertising agencies do some mes- 
sage research, by no means is every advertisement subjected to such 
scrutiny. Consequently, much of the advertising that reaches the public 
is i rri tating, in poor taste or just plain ineffective. One. commercial 
research firm has estimated that only one out of thirteen commercials 
.tested achieves its purpose. And there is even some direct evidence, 
from post- test i ng , that advertising can have a negative effect on sales; 
that is, advertising caused people to think less of the product and 
actually prevented some sales that wouJd have occurred without the adver- 
tising. 

<^ The only insurance available to an . advert i ser , to insure against 
ineffective or negative-effect advertising, i-s pre-testing. When it is 
considered that a single magazine or television ad can cost $100,000 or 
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more, it's only common sense to avoid expensive mistakes by Investing a 
small fraction of that amount in ines^ge research. One large advertiser 
is still trying to forget about a recent year-long advertising campaign 
costing $60,000,000 in all media which had absolutely no effect on product 
sales except to drive many customers to the leading competitor. 

Some Questions Involved In Message Research 

Regardless of whether ah advertisement is intended for the print 
media the broadcast media or outdoor media, there are several basic gen- 
eral questions by the decision-maker which can only be answered by message 
research. 

^/ These may be generally phrased as follows: 

1 . Which selling concept should the advertising emo hasj^? 

2. Vjhich theme best expresses the concept? 

3. Vihat's the best graphic approach to maximize perception? 
Which persuasion strategy will maximize communication? 

5. How should the body copy be written? 

6 . How effective is the complete execution of the finished ad ? 
Those basic questions can be elaborated upon as. follows. 

Out of all the things that might be said about q product, which con- 
cepts should the advertising concentrate on? In the case of an automobile, 
for example, should the advert! sing tal k about beauty, durabi l ity, comfort , 
speed, economy or what? In other Viords, v;hat broad concepts or "sales 
propositions^' or ^'sales ideas'' should be stressed out of all those perti- 
nent to any given product an(^\brand? 

v Given an effective sellino roncov^t or calor^ j^r v-fp<is 1 1 idh , what ' s the 
best specific theme to use 'in a particular advertisement? For example, o:)c 
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can discuss the "economy" selling concept in terms of initial price, low 
maintenance cost, long-life and in several other ways. Should the same 
theme be used throughout a campaign, or should many different themes be 
used to express a s ingle sel I i ng concept? Which ones? 

What is the best graphic approach for attracting attention and enhanc-. 

... 4 

ing perception? In a magazine vehicle, should an iHustration be used or 
not? If so, what kind of illustration? Artwork or photograph? Black-and- 
white or color? How much white space? What kind of typeface? 'How much 
body copy? Or, in the case of a television commerci al , what proportions of 
visual and t^poken are most effective? Should it use. live action or cartoon 
treatment? Should there be a music background? If so, should it be sooth- 
ing or irritating? One continuous scene or several different scenes? ' ' 

What's the b es t persuasion strategy to use ? Is it better to use "two- 
sided" messages in which the competition is mentioned, or a one-^sided 
approach? Should it be an emotional approach or a rational approach? If 
an emotional approach, should one use fear, humor, pa*-hos or what? Should 
one talk about product features or the consumer benefits derived from those 
features? Hard sell or soft sell? Presented by a famous person, an anony- 
mous announcer, or an "off-camera" voice? If a famous person, which one? 

In determing hov/ the body c qpv ) r script should be written , it's 
necessary to consider such things as .sentence length, word difficulty, 
special words for special kinds of customers, creation of abstract or con- 
crete images, loose or tight writing, regional colloquialisms and slang, 
and various other aspects of the creative art which are difficult to 
specify. 



Finally comes the crucial question: how does the total execution of 
t he finished-pr semi-finished ad hold up? If the individual elements of the 
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message-- the selling concept, the theme, the graphic approach, the persua- 
sion blratcgy, the body copy--are al 1 demonstrably effect! ve by theinsel ves, 
chances are that the complete ad execution will be effective.. But there's 
always the possibility of achieving an "o i 1 -and-water" combination of 
elements which, for some reason, don't mix. Only a test of the finished 
execution, or of al ternat i ve versions of the execution, will provide maxi- 
mum insurance against a flop. This is-a form of "quality control" which 
should be applied whether or not all specific elements of a particular ad 
or campaign have been previqusly tested. 

It may not be necessary to conduct research on all these questions 
for every specific advert Psoment or comrnercjua-l , but somewhere a 1 ong the 
line all those questions must be at least considered. In the opinion of 
many -professionals, research on the concv ■ \s and themes of advertising is 
of greater urgency than research at later stages of message development. 

Typical Message Res ; ^'3rch Studies 

• Some of the published articles on advertising and communications 
research provide a good overview of Interest-areas in message research. 
The articles ^mentioned below, mostly from the Journal of - Advert I s I ng 
Research and from Journalism Quarterly , will IT 1 ustrate . some attempts to • 
answer through research the general quest ions the advertising decision- 
inaker needs to knov.'. 

; , In the realm of research on s el 1 ing concepts , Fisk*s article on "Price 
Rivalry Among Phi 1 adelphia Food Cha.ins" determined through content analysis 
the different concepts (n^css^^ge strategics, sel ll.ncjpropos i t ions) used in 
.competing yroccry advertisements, iiukherjee* s article'"A Faptor Analysis 

of Some Qualitative Art r I hutco Cwffoe'' dooll. tluU \\<»vj l» .J <.wn:»umoi 
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to drfnk different brands of coffee, and rate them on ]h different attri- 
butes (taste, smell, etc.); then, through the statistical technique of 
factor analysis, he determined which coffee attributes were most important 
to use as advertising con'cepts. Axel rod's article ''Reducing Advertising 
Failures by Concept Testing" stresses the importance of this phase of mes- 
sage research. 

Research on advertising themes is the topic of Henderson's article 
"Sales Effect^fof Two Campaign themes"; this was a controlled field experi- 
ment of f^oinplete oJs under realistic conditions, with sales as the' dependent 
variables. Vickers' article "A Pre-Test of Four Australian Paint Ads" also 
used compJiete execution's to select themes on the basis of atti.tude and 
opinion responses of consumers. Haskins* article "Pre-Testing Editorial 
I terns and Ideas fo/ Reader interest" describes a method by which article 
and advertisement themes written as headlines can be rated for reading 
Interest as a basis for theme selection. Fel stehausen ' s article "Headline 
Motivation and Reader -Pvesponse in a Farm Magazine" takes a similar approach 
to theme selection. Swanson's article' "V/hat They Read in 130 Daily News- 
papers" determined the reader interest In various subjects or themes by 
computer analysis of readership studies; while his article deals vnth news' 
stories, the same technique has been used in analyzing advertisement 
readership. 

Probably the largest body of published message research deals with 
graphi cs or *'preDen^r,;t ion techniques.'* Belk's article "Immediate Recall 
of TV Commercial Elements" analyzes responses to a number of commercials to 
determine the relative effects of picture, print, voice, sound and length. 
Greenberg's article "Visual Materials and Recall of Magazine Articles" 
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compared the effects of magazine items with and without accompanying 
pictures. Robinson's article "How an Advertisement's Size Affects Respon- 
ses to It" tells hew the eye-movement camera was useful in evaluating 
responses to different-sized ads. Troldahl's article "Predictors of News- 
paper Advertisement Readership" compared the relative effects of creative 
treatment, ad si^s^and product by analyzing readership scores of a large 
number of ads. (^Wells' article "Commun i cat^g Viith Children" showed how TV 
commercials involving motion were more effective with children than if 
"static"' presentation were used. . Ramond ' s art i cl e "Scaling Visual Dimen- 
sions of Advertising" descr i bes how laboratory visual equipment was used 
to find relationships between various ad elements and the viewer's respon- 
ses Typography wa*^: investigated inHaskins' art icle "Testing Suitabi I ity 
of Typefaces for Editorial Subject-natter," in English's article on "Use 
of Split-Run Techniques in Studying and Typography," and in V/rolstad's 
"Adult Preferences in Typography." The use of pictorial matterwas the 
subject of Kerrick's article "The Influence of Captions on Picture inter- 
pretation" and Macleans' article "Picture SeleCts^n: An ^Ed i tor i a I Game ." 
Tinker's article "Effect of Line Width and Leading on Readability of News- 
paper Type" is representative of another much- invest igated area of graphic 
research. ' ■ ' 

The. use of different persuasion strategies has been the topic of a 
great de.:>l of basic psychological research published mostly in various 
psychological journals; most of these reports are on non-advertising , 
topics si:ch as politics and social problems. Advertisers have been slow 
to utilize the findings of that research, or to do research of their' own 
..in tnis very important area. Kover's article "Selecting Commercial 
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spokesmen" is an exception, iTTustrating research on the necessary charac- 
teristics of a persuasive spokesman. Book*s article "Recall of Institu- 
tional TV Commercials" reports on differences In the persuasion strategies 
to be used for women and for men viewers, Adams* article deals With "The 
Relative Credibility of 20 Unnamed News Sources ," illustrating that message 
bel t evabi I i ty can be improved by use of the proper message spokesman." 
Crane^s article " immun i zat ion"-V/i th and Viithout the Use of Counter- 
Arguments" investigates ways to "innoculate" people against later competi- 
tive messages. . » " ^ 

Research on copy v.ri t i ng techniques deals with both headlines J 
body copy. Ways to. improve understandabi 1 i ty or comprehension was the 
subject of Goldsmith's article "Comprehens i bi I i ty of Initials in Headlines" 
and KearT's "Estimating Understanding of Scientific Terms." Another 
requirement of good copy is readability, as dealt with in Carter's article 
"Cross-Cultural Application of Four Fl esch . Formul as Taylor's "Cloze 
Procedure: A New Tool for Measuring Readability," and Haskins' article 
"Validation of' the Abstraction Index," A technique for testing and 
diagnosing copy flaws of any kind v;as described in Carter's article "The 
Content Response Code: A Pre-Testing Procedure." 

^ Most of the studies above were conducted in universities and the pro- 
cedures have been adopted by advertising researchers to varying degrees. 

The testing of complete executions^ (whole ads) is one distinction 
between message research in the print media and in the broadcast media. 
In the print media, it is feasible to test individual elements of ads-- 
separate tests for pictorial matter, body copy, headi ines, etc. In the 
broadcast media, however, it is more often necessary to^use complete 
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executions of commercials since each element depends on and interacts 
Withall the others. Lindley's article "A Behavioral Measure of TV 
Viewing" describes a pretesting method fojr^J^/''^^rr{f]erc\a]s, Caffyn's 
article "Telpex Testing of TV Commercials" describes a quick and Inexpen- 
sive method of testing with videotaped "rough" executions, 

Pre-Testing, Post-Testing and Pilot Tests 

One distinction that needs to be made in message research is that 
between pre-testing and post-testing (somet Imes cal 1 ed pre-checking and 
post-checki n'g) . 

Pre-test i ng simply means message research that occurs before' an ad 
is published or broadcast in one ofyt(\e jwedi a . It includes ofi'taining 
consumer reaction to: individual elements of an ad or commercial; a rough 
complete execution prior to production of the finished product, Including 
TV "story-boards"; even a slick finished production before insertion In 
the media. Whatever form the pre-test ad takes, it is a way of estimating 
In advance, usually on a small sample of product prospects, how good It is 
likely to be. The cost of constructing an advertisement is generally rruch 
less than the cost of publishing or broadcasting it in a mul t i -mi 1 1 Ion 
audience medium, particularly when it is planned to run the ad several 
times; It may be considered as cheap in^Os^r.ce against an expensive flop, 
even' when several vers ions must be tested to come up with one f i na 1 ' adver- 
t i sement. 

Post-^test i ng simply means checking on the performance of an ad or 
campaign after it has appeared in one or more media. Surveys can determir. 
how well an^ad reached and inMuenced its audience in real life, V/hile 
post-test results provide useful hindsight on ad performance. It has a 
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..couple of important limitations. -Or.c Is that ' post-tests of ads as they 
appear in the media will reflect not only the effects of the ad' itself but 
also some effects created by the vehicle in which it appears; it's diffi- 
cult to separate those effects to get a precise reading on the message's 
quality. The other Important limitation is that/ even if a precise measure 
of an ad's quality Is obtained, it's too late to do anything about it — the 
message has already appeared and can't be cor reacted if it had no effect or 

negative effects. Even the most skillful post-mortem doesn't help the 

I, ■ . • 

patient who died. - I r * 

Somewhere between the labels of pre-testing and post-testing are • 
those cases where an ad is actually published on broadcast just once and 
the results tested to determine if the ad should be continued in the future 
for several repetitions, -^' Pi lot test" is the ^best term for such a pro- 
cedure, "Split-run" tests among a small proportion of a magazine's 
subscribers can help determine if it should be placed for complete circula- 
tion. Placement of an ad for complete distribution in a smal 1 ^c i rcu 1 at ion 
publication can hel p "determine if it should be placed in one or more 
largc^ci rculat ion publications. Running a l\i commercial in a single mar- 
ket can give clues tp its effectiveness before placing it on a national 
network; the same c.-in be done in the case of nev;spaper advertisements. 
\Jhi'le the results of such pilot tests are more expensive than pre-tests on 
small captive audiences, they have the advantage of appearing in vivo- - 
under rea \-]/fe natural conditions of audience exposure and selection. 
And they have an obvious advantage over post-testing--the ad can be cor- 
rected or modi^»cd before extremely expensive ]arge-scale distribution 
is attempted. 

^ 1 7r, 
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"What Do You Mean, ^Advertising Effectiveness'?^' 

In terms of the advertising process model, an effective advertisement 
is one that creates maximum perception, communication, and eventually 
desirable consumer behavior. These terms are easy to def i nd^ theore- ' ca 1 ly 
but more difficult to define operational ly--that is, in terms of omething 
that can be measured objectively. 

First of all, It must be assumed that there is no single 'eaning for 
advertising effectiveness. Different ads or campaigns are d=^'9"^'^ 
reach different kinds of people and to achieve different kids of purposes. 
By way of ill us t rat ion , ]a single advert i ser woul d use d i f ^irent kinds of 
ads {h) to reinforce loyalty and repeat-buying among peo;le who already 
buy his brand, (b). to introduce his product to people ^ geographic area 
v;here the product i s . unknown , ' and (c) to capture cu'^o^^^rs who use a com- 
petitive brc3nd. The purpose of the advertising I' each case is different, 
the advertising message itself should be diffe^nt, and the measure or 
criterion of effectiveness should be differe-^- 

Here are two useful rules for advert ^^'"9 effectiveness: 

1 • The purpose or g oa l of advertising must be clearly, stated before 
advertising e ffect iveness . c a'» be defined . For a single 
advertiser, the goal s" v/iTf >e defined differently in different 
cdses. 

2 . The correct measure of adre rtj s i nq effectiveness must be defined . 
in terms of the i ntended purpose in any particular case . 

it is incredible, but true, that many advertisers and agencies will 

embark on an expensive advertising program without clearly defining their 

goals. In other cases, a single goal will be set when. in reality several 

are needed. In other cases, the wrong goal or goals will be formulated 

based on inadequate knowledge of the true state of affairs. Such aimless 

advertising is irresponsible if not downright unethical. 
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Other advertisers, after having <J*-jnned some specific goals, never 
bother to measure the results. 

In advertising, even after specific goals have been set there Is 
still the problem of deciding which of several possible methods of measure- 
ment is best. There is disagreement even among experienced advertising 
researchers on the "best" way to measure effectiveness. As in many other 
fields of education, the best course of action here is the eclectic 
approach--tiiat is, several methods of measurement will be described leaving 
the eventual choice up to the researcher, hirnsel f, depending on the situation 

Reac t ions to Product and Reactions to Advert is ing 

When there is a specific goal for advertisfng, it seems logical to 
define effectiveness as the extent to which a message achieves that goal. 

For example, say that one purpose of the advertising for "Sparkle- *' 
dent" toothpaste is to increase public awareness of it. To increase 
awareness or salience means to make it a name that pops into a person's 
mind when he thinks of buying toothpaste, to make tt a famiiiar and salient 
brand that I s, automat i ca 1 1 y considered when the time comes to. buy. An 
appropriate "awareness" question that has been used on many different kinds 
of products is "\yhen you think of toothpaste, what's the first brand that 
corties to mind?" That is a p roduct avja renes-s question. But one can also 
inquire into awareness of the advert i s-i ng wi th a question such as "When 
you think of toothpaste advert i s I ng , which brand's advertising stands out 
in your mind?" ^ 

There is a crucial difference between questions designed to measure 
responses regarding e p roduct and responses regarding the advert i s i ng for 
that products Past research has shovyn that a consumer can have high 
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awareness, recognition, recall , and attitudes regarding a. product's 
adverti'jing but not regarding the product itself, and vice versa. 
Similarly, an ad can be interesting, believable and comprehensible but 
fail to sell the product involved. 

It seems sound common sense to conclude, that, since the purpose of ♦ 
advertising is to market the product, then the success of the advertising 
should be measured in terms of the product and not the product's advertis- 
ing/ Whether the advertising itself is remembered,* identified, or thought 
of favorably is really irrelevant to the main purpose. However,, consumer 
responses to advertising can be useful for diagnosing the advert i s ing in 
terms of making it do a better job of marketing the product. Consequently,' 
many surveys will ask questions about both a product and its advertising. 
But the researcher should always keep in mind that the creation of favor- 
able reactions to the product 5 s the" primary concern of the advertiser, 
the principal goal of advert i s I ng and consequently the principal goal of 
message research. ... 

'D i sagreement and Agreement Among Exp^rtj^ ' V-'' ' i« ^ 

It would be misleading, to claim that advertising research experts' 
are in complete agreement on the best methods of research for any' parti cu- 
lar measurement problem. As evidenced by the contents of this book, there 
are numerous measurement methods; all of them are In dse, to varying 
degrees . ^ 

But advert is ing . researchers come in a variety of different backgrounds 
psychologists, sociologists, economists, business administrators , ^'vtat is- 
ticians and others. All are firmly committed to the improvement: of adver-^ . 
tising effectiveness through scientific methods, but they see many roads 

• : • ^' " 178 , •■ -■ - •., 
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as leading to the same goal. This may not seem .so strange upon 
considering that, even in some of the "hard" sciences such as chemistry 
and physics, the experts are far from unified on theories and research 
methods. In the "softer" sciences dealing with human behavior, the 
scientific approach is more recent and there is consequently less L-nity on 
theories and methods. 

The considerable discussion and controversy over research methods is 
revealed in a survey of research directors from the 50 leading U.S. adver- 
tising agencies. The Ar^rican Association of Advertising Agencies (AAAA) 
formed a research subcommittee — consisting of highly respected advertis- 
ing researchers — to design a study to get expert opinion on various 
methods of message testing. The conclusions below are based on the '^0 
research directors who replied to the mall questionnaire. 

Primarily the study aimed at evaluating nine different advertising 

measures: ' 

Advert, i s i ng- rel a ted measures of recognition, recall, 
comp'ehens ion , 1 i k i ng , bel iesvabi 1 i ty , persuasiveness 

P roduct-related measures of attitudes and beliefs 
{toward the brond or company)! buying preferences, 

and behavior. I 

f 

All these terms are described elsewhJre so they will not be defined 
here. They were evaluated both as measures of individual ads (print or 
broadcast) and of advert i s i no , campa i gns . I Further, the experts judged 
the different methods according to their/value as, measurements of overall 
effects of a finished advertising execut/ion rather than for pre-tests of 
speci f ic'aspects of copy. Keep in mindlthat these evaluations don^t per- 
tain, to measuring advertising exposure or perception--rather to communica- 
t ion ahd effects . / 
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Val idity for individual advertisements . {Jere is how the nine 
measures were evaluated in terms of the number of research experts giving 
a rating of "highest value" to the measure. 

% rating it of "highest 
Measuring Metho d value" for individual ads 

Comprehension 80% 

Behavior 63 

Attitude ' 63 

Recall 63 

, Buy i ng preference 53 

Bel ievabi 1 i ty 38 

Recognition 15 

Persuas i veness 1 3 

Ad-liking 13 

Thus, a majority of advert i s i ng research experts believed that mea-^ 
sures of comprehension, behavior ,^ atti tude , recall and buying preference 
are qu^"Ve valuable for evc3luating individual ads, in that order; on none 
of the measures was there complete agreement. Note also that most of the 
measures labelled here as "ad-ratings" (bel ievabi 1 ity, persuasiveness, 
liking, etc.) have little value in the eyes of these experts however , 
another ad-rating measure — comprehension of the ad-^was believed to have 
great value. 



Validity for advertising campaigns . For som3 odd reason , the_AAAA 
study asked for evaluation of only four of t!ie above measures,? plus an 
added starter "awareness," for measuring the effects of a4vert\'sing cam- 



paigns. Here is how those five measures were evaluat 
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% rating it of highest 
Measuring Metho d value for campaigns 

Attitude 75% 

Av^areness . 59 

Guying preference ' 59 

Recall ^0 

Recognition • 15 
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A majority agreed that attitude, awareness, and buying preference 
are of great value in measuring campaign effectiveness. Recall end recog- 
nition have little value, according to the experts. 

Validity related to test conditions . Several other questions were 
asked about research methodology in ad testing. 

Exposure of test advertising should be under natural conditions 
rather than artificial conditions, by a two-to-one margin of opinion- 
There was a two-to-one preference for experimental conditions of 
measurement (i.e., using a control group) rather than for comparative 
descriptive measuremen Ls- In effect, they favored controlled experimental 
designs rather than after-only or before-and-af ter designs. ^ 

Should ad tests use rough o_r finished executions? About half said 
it doesn't matter, and the others were equally divided between those pre- 
ferring roughs and those preferring finished executions. 

Are the res'.c rch methods of different value In testing print and 
broadcast advertisements? Eight of the nine individual ad measures were 
judged of equal value for both print and broadcast testing. Hov^ever, the 
recognition measure has higher value in print ad testing according to 
one-third of the researchers, the remainder fc<>ling i t makes no difference. 

Should, and can, sales be the final criterion of campaign effective- 
ness? ' Even on this vital issue the. research experts vere ir. d i sagreement-- 
exactly half felt that sales is the ultlniate measure, xhe other f-^lf did not 
Furthermore, only about tv;o-thMrds of tlic experts bcl 1 cmoJ • that sales con 
be measurLtjrij_^ sufficient precision for testing advertiiing; this may 
reflect the fact that sales arc indeed easier to measure x-^r certain 
products than for others.. ^ Bi 
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Some additional comments in the committee report should put the 

above findings in better perspective. 

These conclusions are based on consensus, but 
consensus is not In itself a guarantee of the 
validity of any measure. • . . There appears to 
be a dilemma on some measures between the bette r 
measure and the more pract i cal measure . . . 
some measurement methods and techniques are 
much more a compromise rather than superior. 

It was made clear by the experts that individual advertisement testing 

is done for a different purpose thiin campaign measurement. Copy testing 

of individual ads is performed as a diaqnost ic procedure, to determine ' 

"why" an ad doer, we)! or poorly and to provide remedial information- It 

is unreasonable to expect a single advertisement to produce sales, expect 

in special cases. 

In any event, the lack of complete agreement among the experts indt- 
Gates why so many different ways of measuring ad effectiveness are used, 
many studies using the "grab-bag" approach of measuring everything 
possible. Further methodological research will some day clarify some of 
these problems. 
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CHAPTER IX. PRE-^ESTh.'G MESSAGES 

Pre-testing simply means testing an advertisement, or some part of 
It, before it is published or broadcast. One can pre-test selling con- 
cepts, themes or headlines, graphic presentation techniques, persuasion 
strategies, body copy or whol -ilons. One can obtain different kinds 

of responses--verba1 , physiological or behavioral. On:: can measure reac- 
tions to ads themseves or to the products contained in the ads. One can 
present the t2St fnaterials in homes, testing studios or laboratories , or to 
individuals and groups in their natural habitat of stores, airline termi- 
nals or wa i t i ng rooms . . 

In short, there is practically no end to the different ways in which 
ads can be pre-tested. This sect'on contains a discussion of some of the 
most important kinds of^ pre-test ing situations. A thoughtful reader can 
fill in v/ith other likely va r i at i ons and combinations of pr^, -esting pro-- 
cedures. 

Pre-testing is usual ly concerned wi th testing the relative performance 
of alternative executions compared with each other, since there are fev/ if 
any absolute measures "of message effectiveness. 

General Pre-t est Guidelines 

l/hilc there is much discussion and little agreement among advertising 
researchers on specific techniques of pre-test i ng , .all wi 1 1 agree that 
pre-testing is desirable. (Curiously enough, a great deal of advertising 
is not pre-testevi. ) And most would agree with these general guidelines 
for copy testing, as expressed by large-agency research directors at recent 
conference 
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'■'Copy research is meaningic^^s and ever, mt si wading unless it is 
conducted among the t^rgat prospects for the advertised brand . ' ' 
Several studies have shcjn that the responses of the general 
population, or non-prospects, are different from prospects, 
"Copy research is inefficient and sometimes quite ambiguous 
unless Prec edgd^by^^ade^uat^ about what to communicate 

and to whom/ ' An integrated research program is viev;ed as con- 
sisting of: market end motivation research, to define the ^oals 

for a particular product, at a particular stags in its li fje 

( 

cycle, in its particular competitive environment; concept research 
fo11cv;s, to determine the best message in light of these goals; 
copy research deals with the part i cular creative execution of the 
basix: concept; effectiveness measurement is needed to tr^-^ck 
-advertising performance over time in the total market environment* 



3 • Copy research is incomplete' if it m easures only r esponses to 
the a d vert ! s t ng • measurement must also include responses to the 
product The attention value of the advertising itself as in 

^^real-life exposure, plus the effects In terms of response to the 

product, crucial to successful measurement. 

^ . "Copy research ts sterile unless it contains informctlon on t h e 
elements accounting for the responses obtained ." It^s not enough 
to t<novv which ads work and which don ' t ;. d i agnos t i c information 
on why they were successful or not is essential to true under- 
standing, 

5 , "Copy research, if it is to be predictive, must validate its 
methods." A- copy test or method is misleading and even harmful 

184- 



1 03 

if the results in real-life are different from those obtained 
in the test. Somewhere along the line, validity of copy 
testing methods should be dernonstrated through basic research, 
not merely assumed. 

"Most copy research deals with single ads or corr:mercial s . 
Ways must be found to pre-test ccmpalgns .^' Because of the 
minimal effects of single messages in the real world, single- 
message tests may not reveal much. 

"The cop y tester should v;ork closely v;ith the business and 
creative gr ou ps of the advertising agency ." This makes him 
more clearly av/are of v;ider range of alternative ideas for 
testing, and increases the actual use of the rejearch results • 
in creati^on of the advertising. 
' ' Copy performance m easures mus t be_found whir^. i reflect the 
sal es goal of advertisers ." The ultimate goal of advertising 
is sa 1 es , and--.even though advertising is only one of the 
forces influencing sales'-methods of pre*testing ads and cam- 
paigns should use measures that are related to sales; this 
requires research v/hSch measures sales and cornmuni cat Ions cri- 
teria simultaneously and identifies those communications 
measures which are most relevant. 

"Copy research should lead t o th e developme nt of genera) 
p^rinciples of ad cons truction ." Research to satisfy curiosity 
regarding IrrimedJate problems and individual ads must be 
standardized so that a systematic body of knov^ledge can be 
built up aided by thorough record-keeping on ad performance. 
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For the person who wants co gc boyo'd being sln^ply 3 technician, 
those are the kinds of problems vyhich can provide substantial challenges 
and rewards. f 

The Importance of concept testi ng. Many researchers maintain that'^ 
adequate pre-testing of selling con'., ts is more valuable than testing 
of themes, graphics, persuasion strategies, 0/ v;hole ad executions. For 
one thing> this approach provides information at the earliest poss'jle 
stage in development of an advertising campai gn^, before the considerable 
expense of creating rough or finished advertisements, either print or 
broadcast. Man/ different ideas for selling a product arfi always gener^-^ted 
at the beginning of an advertising effort — there is much evidence to 
suggest tl^at "what you say" is more important than "how you say it." 

• Concent pre-test procedures have been used for several purposes--- 
for selecting the best concepts out of rrany available, for stimulation in 
creating new conce;.>ts, for diagnostic information to help the creative 
staff make more effective translations into finished copy. * ^ 

In most concept testing techniques, the prospect- respondent is exposed 
to one or more stat'^.ments , each focussing on a single i dea , " usua 1 1 y ■ wi thout 
mention of the specific brand but concerned only with the product M tself. 
Verbal responses from personal interviev;s are the usual thing, but physio- 
logical measurement in other research situations is also used. 

The most common methods of presenting the concepts are: paired- 
comparison , rank-order , guided-usage and own-brand comparison. 

In the paired-comparison procedure, a respondent is presented with 

J 

two different produC^ concepts, told that they represent different brands 
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of the s-rime product, then asiccd to express his preference and the reasons 
why . 

In the rank-order method, a resporident presented with a series 
of product concepts, asked to rank them in order of preference and the 
reasons for his choices: this is different only in degree from the previous 
method. 

' \ 

I he quided-usage test is qu.te different. The respondent is exposed. 

\ 

to a product or given a sample of it for a ti|^fal usage, along with a 
single concept. After trial he is asked to cDrr.ment, Different concepts 
are evaluates by using matched samples. 

In the own-brand comparison method, the respondent is asked to evalu- 
ate one or more product concepts against the brand he now uses. 

Other researchers maintain that selling concepts can only be tested 
in the form of complete ad executions. Regardless of the method of test- 
mg, however--many more of which will be discussed in the sections that 
follow — the advert i s i ng researcher should be aware that concept testing 
may be the most important stage of Investigation. 

Genet'wJ P re-Testing flethods 

\ ■ 

[The group discussion met hod . Small groups of respondents are some- 
fnMc:> cisscmbled for a round-table discussion of an ad or a seriesXof ads. 
\/hile this is not presumed to be a typical advertising exposure situation, 
the interaction and stimulation of several consumers on each other\is 




sometimes. helpfuJ in diagnosing weak and strong points of an advert . jerneri^^ 



The primary benefit from such discussions is likely to be in what it 
reveals about consumer motivations and only secondarily an evaluation about 
advertisements used as stimuli. 
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This method--3]so Icnown as "he ''consumer jury'' or '^focuses jroup" 

technique-- 1 s rr.ost often us d In the initial stages of planning an ad or 

carnpaign. p rov i des a i^eat i ve stimulus for the artists and writers rsspon 

sible for producing an ad, and it simultaneously keeps their ideas grounded 

in the reality of hcv; product users th'*r.'r and feel. This latter point is 

very important, since advertising people usually liv- and work in a world 

which is quite different from th-^t of tH^e typical consumer. 

\ 

While group ^^embers are scire tiiTif^s eoK'.d to give numerical ratin-s 
or rankings cf ads used in the discussion, these are not r-?liable as quan- 
titative indices for a variety of reasons--too few people in the group for 
statistical significance, undue influence of some individuals on others, 
the abnormal exposure situation, and others. 

Projective methods. . Another way of getting at the deep-down motiva- 
tions, desires and preferences of consumers is to get their reaction to 
vague and amb i guous s t i mu 1 i theit can be interpreted in a variety of ways. 
Thus, Instead of showing an advertisement, the researcher might show 
neutral fraamentary pictures, words, or situations and ask the respondent 
to tell a story about it, fill in the details, complete it. In short, the 
reasoning is that the respondent wi 1 1 '^project" himsielf into the scene and 
reveal his underlying thoughts or feelings. 

The principal types of project ivemerhods ^r^^^hJM(:J^^tTor\ '^^^\V\o,\\e.s ^ 
construction techniques and completion techniques. 

In the associ at ion techniques, the researcher presents a word, an 
ink-blot (the Rorschach test) or some unid^iified shape such as a cloud, 
and the consumer is instructed to respond with the ^irst v;ord, thought or 
image that occurs to him. An illustration of word association: "\ihat*s 
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the f^rST: thing you think of v/nen I say HOT? FLOOR? AUTOMOBILE? 
HEADACHE? SPARKLE-DFilT TOOTHPASTE?" {and so on). 

In the construction techniques, the researcher presents a scene or 
picture^ and the consumer Is instructed to make up a story about it; the 
Thematic Apperception Test and the Blacky Pictures are standardized ver- 
sions of this technique* An illustration: "Here Is a picture (picture 
shows Viornan handing tube of toothpaste to man about to brush his teeth). 
Ohat ai"^ i:^ey saying to each other?" 

In the completion technique, the researcher shows an incomplete sen- 
tence, an incomplete picture or some ether unfinished stimulus-object and 
the respondent is instructed to fill in the details or complete it in any 
way that he wishes. An illustration of sentence-completion: "The ideal 

toothpaste is . :^st toothpastes are • Sp^-kle- 

Dent toothpaste is 

These are only a few of the different kinds of projective methods, 
variations of whlcl. may b called "unstructured'' methods, "depth" inter- 
views, or "moti vatic: srch" irethods. They jare not so often used Jn 
testing complete ads as in getting ideas for silling concepts' or persuasive 

copy, ^ 

The crucial points in the' use of projective methods lie in (a) select- 
ing the proper stimulus to. preserKT to the respondent, so that he will talk 

about the topic desired, C'b) making the stimulus neutral or ambiguous so 

I 

that the respondent projects himself into the situation rather than simply 
describes something already present and (c) interpreting the respondent's 
remarks in a meaningful and objective manner so that powerful advertise- 
ments can be constructed from them. Th^re has been much disagreement about 
e 189 - 
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the value of motivational research BiaOng researchers on this lattei point — 
that is, if different researchers interpret the same respondent's remarks 
in different ways, one can seriously question the validity of the results. 

Hov/everj questionable project i^'e techniques may be research tools, 
they are undcubtediy helpful as creative tcols--that i? ^.s sources of 
ideas for the people who produce advertising, or for researchers as a basis 
for formulating structured tests ard'^measures . 

Laboratory a pparatus methods . Specially designed laboratory equipment 
can obtain non-verbal or physiological responses to ads in any stage of 
development. The equipment 13 usually designed both to present an adver- 
tisement under strictly controlled conditions and to record simultaneously 
the reaction of the respondent. 

The eycmiovement came ra is one such device used primarily for print 
ads. A respondent's heaa is fixed into a particular position so that", as 
an advertisement is presented, a special camera can photograph his pattern 

of eye movements, abo/lt the ad--the place of first fixation, second, and so 

.1 ■ t *• . 

on, so' that the eye'-movement pattern can be charted just like car tracks 

over soft ground.;^ By testing a number of respondents in this v.'ay 3 the 

I 

t y ■ ■ 

researcher can deduce v>jh i ch parts of the ad are being concentratea upon or 

ignored, the best sequence for organ^-zi^-ig the ad's visual elements, and so 

on. Having found the "weak" spots in an ad, the ad may be redesigned then 

re-tested until the desired effects are achieved. ' . 

/ 

The gal vancmieter or psychoqal v<^nometer is a devic^ attached to a 
respondent's hand to measure changes in electrical resistance. \Jhen shown 
something exciting, a respondent's nerve activity v;ill result in 
perspiration which in turn increases electrical conductivity, just as any 
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object beccriies a l-.tter electrical conductor wnen stending in a puddle of 
water. When a respondent is relaxed, there is virtually no sweat. A 
respondent viewing several different ads will involuntarily reveal varia- 
tions in interest through automatic recording of his electrodermal response 
(ED?.). One prcblen, hov;ever, is that both an extremely unfavorable reac- 
tion and an extremely favorable reaction will cause excitement and shov/ up 
in the same way on the graph. ^ ' \ 

The electroencephalograph is a device which measures the electrical 
output of the brain, anu changes are revealed by fluctuations on a graph. 
Eleccrodes are attached to the head, then as various ads are presented a, 
graphic record is made of the ^'brain v/aves-' which result. 

The eye pupi 1 camera is one of the more promising devices 'used in 
testing print advertisements. A specially designed camera measures tiny 
dilations and contractions of pupil diameter. Pupillary dilation, or 
increase, indicates ^ fov^iablo rc:>Hui.3c whi'lo con L i cici lun indicotes a 

Scme other laboratory measures of physiological response to ads 
include: respiration (breathing rate), pulse rate, blood pressure, glandu- 
lar biochemical changes (blood sugar, adrenalin, etc.), uterine contraction, 
salivation ("drool inq") and muscular contraction. 

These 1 dbui\3 Lof y 'tiev i cps to measure physiological response are not 
a Twoyb precise enough to measure the rather small changes usually evoked 
by advertisement. And, as noted, there are often problems in interpreting 
the data. However, the eye movement camera and the eye pupil camera have 
becor- '• 'ortant tools in pre-testing; with ref iv: 'ii^^nts in equrpmeht and 
techh. ,ue they may become even more important. 
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The tcchi stoscope is a divica for present: -5 print,.3ds for any desired 
duration — cne- thousonith of a secon :; , cre-hundredth , cne-tenth, and so on. 
The rationale is tnct th? quicker an ad can be perceived and comprehended, 
the r?.ore attent lon-gettinc it is likely to be in a real-life advertising 
situation, since readers are known to scan through a magazine or newspaper - 
rather rapidly. Tnus, a group of respondents may be presented with several 
ads, 2nd everytfiing else being equal, the one that is recognized fastest 
is probably superior in attention value. The tachi stoscope st:.ri$ by 

presenting an ad so quickly that no one car see it, then the. duration 

. . *> 

ti'Tie IS gradually increased until a respondent arrives at his recognition 

threshold. The "ccfr.rtun i scope" is one rr.odel of the tachi stoscope specifi- 
cally designed for advertising tests. 

The ''program analyzer" is a laboratory o^vlce which measures conscious 
reaction rather than involtinicii / phys i ol o^j i ca 1 respcnse?^"-i/hen exposed^ to 
a broadcast commercial cr program, a respond-z^nt indicates arr.ount of Inter- 
rist by twisting a dial (clockwise if enjoyed , counterclockv;i se if not), or 
by nfeVing a SA^i tch to left or right, or by pressing one of a series of 
buttons. An auditorium or studio can be fitted with several dozen or 
hundreds of response stations for group testing. A continuous graph of 
group reaction can be automatically and continuously recorded, indicating 
the affect (i.e., degree of ^liking or disliking) for any portion of the 
broadcast stimulus. At points where the graph line plunges down, change^- 



can be made to improve the ad or program performance; verD<Sl question! no 
of respondents on their reasons for liking or disliking certain portions 
provi des vu) u.^hl e diaqnosric data for improving effect iveness • 
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Binocular devices . "BI nocul ar ri val ry" is the, term used for present- 

ing two ads simultaneously to determine relative attention value. When 
extraneous factors such as eye dominance, illumination and distance are 
controlled, the relative attention value of several ads can be. determined 
by presenting all combinations of pairs through the binocular device. In 
each pair, the respondent will perceive only the dominant ad. This appa- 
ratus has been used primarily in testing alternative graphics .techniques 
\^ print- adS'-]ayout, color, pictorial elements, etc. 

These laboratory devices may be used ^"i ther , s i ngly or in combination. 
For example, one commeTci a 1 . test i ng f i rm--Aud i ence Surveys, 1 nc . --useS' tlje 
program analyzer and tt,e galvanometer in combination with verbal question- 
ing tQ pre-test TV programs and advertisements. 

^ As in other forms of researc^i, the validity of. the data depends on- 

the extent to whichthe pre-test respondents are representative of the, 

s 

larger population for which the advertising is intended. 



Other general research methods . Many other variations of general 
research methodology are adaptable for pre-testing. At this point, it may 
be useful to review fhe earlier chapter on "The Most Common Advertising 
Research Piano." "Sample surveys, laboratory experiments, controlled obser- 
vati-on, content analysis, controlled field experiments, and attitude measure 
ment--all have their uses in pre-tesling. 

Broad cast lessage^P re-Test in^^ . 

In addition to some of the general pre-testing methods already 
described, several other methods are available far testing broadcast com- 
mercials and programs. For some odd reason, very litfle pre-testing of 
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radio materials has been reported, her;ce this section v/ill concentrate on 
television; hov;evor, most of ~these methods vjoiild be equally well-suited 

for radio. * \ 

( 

Commerr.ial form for test, ^g . One important question for advertising 
researchers in this connection is: Must* a TV commerc*ial be in slick 
finished form for testing, or will a prel iminary rough version. do the job? 
The questio^n is important because the* producf ion of "a finished commercial 
can be very time>copsumi ng and expens i ve---therefore\ the use of .rough pre- 

lim?fiary versions wou:i<i save much time and money, .v. 

' ' J ^, • ' 

Three principal forms of commercials for testing are most corTimon — 
s^oryboard, rough/ and finished. - . . ' 

The story boa rd form simply shcv/s in sequence a number of still scenes, 
which convey in sequence the "plot,"' the principal images and words involved 
In the planned commercial. The scenes are sometimes artist's renditions, 
sometimes photographs. A projector may be used to flash the stills on a 
screen in rapid sequence — a^i in film-strip showings. Sound may be super- 
imposed over the visual scenes--mus i c , narration, sound ef fe^r.ts-- to further 
simulate a real commercial. There is a wide range of pol i sh^ posb Ibl e with- 
storyboards, ranging from simple sketches'of ideas in the earliest stage 
of development to painstaking executions including all commercial elements. 

The rough commercial form for pre-tests is spmilar to the commercials 
actually seen on television. However , i nstead of highly-paid top-flight 
announcers and actors, they may u^6~^oev.er happens to be h"'.dy; instead of 
expenf,: ve f i Iming "on location," studio scenery or a stock film background 
may be substituted. The script may not be as finely poJished as in the 
final version. In short, it is a preliminary "rough draft" of the final 
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product ;-...severa'l rough commercials can be produced within the cost and * 
time required for fijm'ng a single finished comnerc i al . .n this way, tf>e 
essential ingredients of several ideas can i^e tested, the obviously Inef-*, 
fective ones, thrown out and the promising ones modified,, to increase the 
seteyng power of the final version. 

Sonet ! me s advert-isinq agenc ? es produce the i r own ' cough co.Tme rc i a 1 s » 
sometimes they hir.e outside firms to do the job. One firm that specJalizest 
■5n both production and pre-testing of rough commercials is Telpex, Irrc, 
Telpex's "Instant proQuction" facilities make It possible to video-tape 
several commercial roughs in a single day, view the commercials immediately 
after shooting, make changes in them as desired, and then re^::hoot them wi-th 
improvements. "These can be shewn immediately in a test theatre next door to 
specially selected audiences of about 50 persons at a time; Audience reac- 
tion questionnaires can be analyzed quiciily and reports produced ^oon 
thereafter. . - 

This procedure eliminates one of the major problems In pre^test i itj TV 
commerciaOs--^t ime. In the space of a few hours or d^^jv*^ , several Ideas can 
be produced, tested, and a decision reached for final product^ion. 

A f in i shed comtrterc i a h can also be used for testing,, of course, and some 
researchers argue that this is the only way to get an accurate evaluation. 
It probably does provide a som'ewhat more valid measure of effectiveness than 
less-finished versions, but the question is '"Hov; much moi' ^ ilid?" and "Is 
it worth the extra cost and, time?" Then too, there is a psychological haz- 
ard in using finished commercials in testing since agencies" and* advert i scrs 

are reluctant to change or throw on- the scrap htap a finished com.mercial, ^ 
even if test results sho\^it to be ineffective. 

in practic;^! tcnns--cons i der i ng production cost, media costs, and the 
low probability of success for mit^Gtcd coimncr ci <j1 s- r ti^c pre-tccting of 
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several stOryfaoards or rough commerciajs to produce one e1-f«3Ctive finished 

corrjne rc i a i would appear to be a wise i^ve5t^nent. 

. Different TV pre-^testinq environments . Another question that arises 

V 

in pre-testing TV conirnerci a1 s concerns the situation or envi roa'Ttent ifl ^ 
which the respondent views and^ responds to the test' "message. 

The most ccnimon test environments are auditorium tests, in-hone tests, 
on-the-air tests, and split-cable tests. They may be used for testing 
complete program formats or commercials or both. 

in audi tor ? um testing , a group of people may be deliberately assembled 

a studio, theatre , classroom or audi torium, or portable trailers with a'^few 

seats and projection equipment may be moved around to catch consumers in 

\ ' t 
shopping centers and other natural habitats- This "captive audience'" tech- 

'i ' : . . \ 

nique is the fnost frequently used test environment- . It lends itself to! 

pbtaining various kinds'of verbal or physiological responses from a number 

of people sirnul taneously. . ^ 

The commercials to be tested are usually buried .in other content to 

disguise as much as possible the real Intent of the procedure. For 

example, the audience may be shown a real movie or TV program instalment 

wich several different commercials interspersed, though only one is the 

object of testing. In addition to tests of different commercials, the 

auditorium method is used in testing different presentation techniques — 

e.g., placement of commercials in programs, length of commercials, and so 

on — by having a di'fferent group see^j2^h alternative. 

/ The researcher may gather ad-rating information (enjoyment, interest, 

^ ' /■ 

.persuasiveness, bel ievabi 1 i ty, etc. ) ,M-eca1 1 of sales points and other 
verbal responses. The Schwcrin Research Corporation^-formerly one of the 
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leading testers of televi5iQa-Xorr.raercials— disguised the purpose of the 
'esscmbly as much as p<5ssibie, and obtained brand-preference ratings before 
and after exposure to the test nessage; the change in preference v;as con- 
sidered to be a measure of the selling pov/er of the commercial. 

Another testing f i rm--Aud i ence Surveys, Inc. --uses laboratory equip- 
ment, such as the program analyzer and the, gal vanometer to obtain diagnos- 
tic data in auditorium tests. These responses may be combined with ad- 
rating responses, brand preference change, and other verbal responses to 
get a comprehensive evaluation and diagnosis of d i f ferent*^ commerc i a I s - 

The i n-homie test utilizes a portable lightweight film projector that 
can be carried by an interviewer to individual consumer homes. The test; 
film is shov/n and the respondent is questioned as in some of the other 
survey situations. 

The on- the- a i r test involves actual broadcast of a test commercial in 

t 

a regular TV program format in one or iT^ore cities. The local station cuts 
in on the network program at commercial time and shows the test commercial 
instead of the one'being nationally or regionally televised. Sometime 
later, personal or telephone interviews are conducted in a sample of area 
homes. 

The spl t t-cable method of presentation is considered by many re- 
searchers to be the most valid method of measuring the effects of a com- 
mercial. Within dertain cities,. it is sometimes possible to cut in on a 
broadcast and simultaneously beam^ Commercial A to one group of homes and 
Commercial B l|o another matched group. Or one group of homes can be' 
'•blacked out" jand receive no commercial at all, and thus serve as a control 
group. Interviev^s arc then conducted with a sample of respondents from 
both groups of homes. i a ry 
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Each of these different TV pre-'test environments has' its advantages 

and disadvantages. In auditorium testing, the primary advantage is in the. 
tester's complete control over all details of icmmerci al transmission and- 
reception, and in ttie feasjbility of laboratory-type response equipment; 
primary disadvantages are the unnatural ''forced -exposure'*, to the commerciaj 
and the non-typical sample of respondents (people who will a^ear for such 
a test are 'd i f ferent in many respects from people who .refuse). The in-horrie 
test can come up with a representative sample of respondjents , but the, view- 
ing situation is quite artificial. The oh-the-air test shows tfie xommerc ial 
under natural viewing conditions, but the lack of an adequate control group 
makes it impossible to isolate the effects af the test canmercial from the 
many other influences in operation. The split-cable method comes closest 
to^^^tta i n i ng representative samples, natural viewing situations, and control 
over extreneous influences — however, the cities in which it c^n be used at . 
-present are .few and probably not typical. " . ' * 

Many major advertisers have conducted exhaustive investigations into 
the various methods of pre-testin-g TV commercials. .All have reluctantly 
decided that the perfect method is yet to. be found. Consequently, some use 
one method and some another.. 

Print Message Pre^-Tes t>i ng 

The "ad-rating" r^ethod . Pres'ent the respondent with several print ads, 
either simultaneously or in sequence. He is then asked to rank the ads 
(first, second, third,. etcO or rate them (on a 100-poInt rating scale, for 
example) on such 'dimens ions as reading interest, enjoyment, be 1 i evab 1 1 I ty , . 
attractiveness, persuasiveness , good vtaste, useful i nf prmat Ion ,° stimulation* 
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of^^desire for the product, end so on. Or he r^ay sinply be asked to say 
which he likes best, v.'hich he likes least, and why. 

A variation of this procedure is the "paired-comparisons'' method. * 
The respondent is first shewn X and Y toget-her and asked to choose one 
that is Tiost enjoyable, persuasive; etc.;'he is then shov;n the X2 pair, 
then the YZ pair, and repeats the rating process for each pair. Soma 
researchers maintain that people can't rel iabl y j udge or discriminate among 
rncre than' tv;o objects at the time; therefore when getting judgments on 
three ob more ads, they recommen'd showing the ads to respondents in poirs. 

The "ad-rating*' method is also sometimes knov;n as the '-'order-of- 
mprit" method, because it basically requires a respondent to rank a num- 
ber of ads in order'^rom best to worst' along some dimension of judgment. -^^ 
This method i s ' frequently used for "quick and dirty" tests of alternative 
advertisements. But it is of dubious validity, for all the reasons men- 
tioned in a preceding- sect ion on "How f^ot to Determine 'Ad Effectiveness." 

The portfolio method . . This is- a method of testing complete ads in 
whicjj a test advertisement is presented to respondents along v/ith several 
others in a fo^der> or portfolio. The respondent is asked to look through 
the. portfol io, taking as much time as he*likes, and then is questioned 
about which ads he recalls, v^hich products were advertised, what pnoduct. 
facts he remembers and so on. 

The crucial difference between this and the "ad-rating" method is that 

the respondent isn't aware which ad or ads are the real subject of inquiry, 
/ " ' < - 'V' ■ ' . 

vBnd the response is considered more similar to what. would occur in real 

life., • . 

In the case of three test ads--X, "p^ and Z--three portfolios may be 
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made up, alike in every respect except tor the test ad. A group of 
respondents ?s randomly divided into three samples, then each sample .sees a 
different portfolio. Since the portfolios are alike except for the one 
test '3d in each,' the difference becv;een the responses to X, Y, and Z indi- 
cates the di fferenti al effectiveness ; responses to the other ads (called 
control ads, since they are the same for all croups) should be equal for. 
all 'three groups. " * . , ' 

- - The portfolio meth»od is one way of disguising the real purpo^se of the 
researcher and therefore is supposed to result in more valid measurement 
than if the resfSondent knows what^s expected of him. 

Another version of the portfolio method is the '^ dummy magazine .'' 
A test ad is bound into what- appears to be a real magazine-'complete v.'Ith 
cover, a.rt\cles, stories and other ads. Some commercial testing firms 
regi-larly publish a dummy magaz-ine for the specific purpose of testing' ads. 
This- is considered a better research disguise than the ad portfolio. 

The spirit- run method . This i^s a way of testing two or more finjshed 
executions of print ads-in a controlled fi^eld experiment. it might more 
properly be called a "pilot test*' rather than a pre-test. In its simplest 
form, a pubj i cat ion * s printing press can he set up to insert Ad A in one-' 
half the copies, and Ad B'in the other half. After publication and circula- 
tion, Intervjews can be conducted with the two groups of respondents and 
the differential responses t^o the ads compared. The split-run can some- 
times be arrange'd to alternate atls A and B to every other «name on a sub- , 
scrjption list. Somewhat easier to implement is the* "every other market" . 
technique, iri which all copies gofng into one group of c i t i.es^ get Ad A and 
all copies going into another matched group get Ad Then there is the 
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'checkerboard" design — usually used by newspaoe^^s^ — in which .a single city^ 
rs divided into squares or segrneniis like a che^k(?''bc>ard , and each segment 
gets a different ad- version. The Hi Iv/aukee JQj jrn^l has pioneered In the 

.devsloprnent of this form of ad testing and set up a complete production, 

' i 

distribution and research procedure to accommadet^ advertisers ivlshing to ' 
-test the I r ads, 

instead of conducting interviews to measiJ^e r^^ponse to the ads, 
coupon returns are frequently used, A coupon, printed as pa^t of an ad, 
is coded so that it's easy, to determi ne( the nO^he^ of returns produced. oy 
each of the test ads. This is a particularly effective method of measure-- 
fp.ent foV. several reasons. !t doesn't rely on^'^erba.! reports, and little or 
no research expense is incurred. The coupon rettJrn is an .undeni ably valid 
measure of effect ? veness > part i cul ar 1 y . for businesses which rely heavily . 
on mail-order sales. International Corresponci^nC^^^ Schools has a continuous 
ad test trig program usin^ coupon returns from $pl?t-run experiment's. Over 
the years, ICS has accumulated a considerable knC>Wiedge of the principles 
of good advertising for tlieir purpose, based . $Uc^ research results. 

Coupon returns are also known as *M nqu i r i * Sometime^ prizes or 
premiums or free samples are used to increase inciuiries. The validity of. 
inquiries as measures of ad ef fectPvenebs dt:p*^nd^ the extent to which 
the inquiry is related to sale of '.the product' the case of a (nail- 

order business, the relationship between In'qu'ry sipd sales is direct antf 
there is no doubt -^of the validity of the .meas>Jre * Hov/ever, free premiums ' 
or contests may attract large numbers of Inquiries and not have any effect 
on product sales; fhus, in 'the case of non-maH <^rder businesses, addi«|;ional 
research. may be necessary to det^mine whethe^ coupon returns and inquiries 
have any relationship to increased sales of the product. 
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ConierH: response code . This print ad pre-test method is a combination 

of coatent analysis and consumer survey. It has been used primarily for 

/ * 
written rraterial, tf]bugh it has also been used for ads comblninc v/ritteri 

/ 

and pictorial natter. It operates like this: a small sample of the 
;i ntended\target audience, is selected; each one is instructed to read the 
test ad in its entirety a^d to mark with a "minus" sign any s^egment^ that 
they, find disagreeable, hard to understand or negative in any other way; 
similarly, he is to mark with a "plus" sign those segments that are highly 
agreeable, persuasive, or interest ing 3ny anyway. Tbe combined judgments 
of the respondents are then used to plot a graph of the whole message--qui t 
similar to the "program analyzer" graph produced by mechanical equipment in 
pre-testing broadcast programs- aqd commerciale. Inhere there are serious 
"valleys" or weak -spots in the ad, the respondeat5 _ar ^^quest ioned further 
on their reasons for judging it negatively. Corrective ctianges are made, 
then the whole ad is re-tested with another sampl e -of • the target audience. 

This method was developed by a university researcher, Dr. 'Roy Carter, 
fo*r use with U.S. Government propaganda leaflets. Though it has not been 
v>ridely used in advertising, enough has been don-e to -indicate that it has 
considerable potential for Improving print* ad effectiveness. ^ 

f Pi rect mai 1 method . ♦ This is a slightly different form. of "spVit-run" 
using mailed ads' to lists of prospects or other special target groups. 

Two or more alternative ads can be pre-tested for pulling power by randomly 

. • 0 

dividing a mailing list Hnto two or more sub-groups as , needed. Differen- 

tial effectiveness may be measured by the number of 'mail orders returned, ^ 
« 

by questionnaire surveys of the recipients, or by coded "money-off" coupons 
to be turned in^^by recipients when making a personal purchase. An 
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additional poss ibi 1 i ty wi th di rect-pa! 1. is that; different advertising 
appeals can be tested arr:ong sanples of the safr;e- group, or the same appeal 
can be tested arr.ong many different kind? of groups; specialized mailing 
lists for almost any known kind of person can be piirchased--barbers , teen- 
agers, sports-car owners, or v;Hoever. 

One assumption in the use of direct mail, as a pre-test for magazine, 
and newspaper ads, is that the results would turn out che ta-e if actually 
publi'shed in the desired medium; this assumption may or may not be correct 
unless validated by additional research. Once validated, however, direct- 
mail can provide an extremely accurate i nd i cat iort of differences in ad 
effectiveness. It is as ad^table for small-scale local advertisers as 
for large national concerns. 

''Advertising Puzzle Game'^ .A print ad layout is develc5ped, but v/ith 
a blank space where the main illustration is to appear. The incomplete ad^ 

.aitB several different illustrations are presented to a respondent , who is* 
then asked to complete^the puzzle with the most approprI<ite illustration. 

The same procedure ctn be followed with headlines, or other ad elements. 

As mentioned earlier, the number of pre-testing methods is limitless, 

■^br limited only by the creativity and imagination of\ the researcher* 
himse1f--and most competent researchers are qu|te creative, adapting baiic 
existing methods to fit particular situations. The preceding discussion 
has covered most of the comCion procedures. 

Outdoor Message Pre-Testinq 

Many of the pre-testing methods previously described can be adapted 
for testing posters and car-cards. Group discussions, projective techniques 

•203 



laboratory apfparatus, content analysis, controlled observation, aaditoriun 
testing, ad-ratlngs, and spl i t-rugs--f^] 1 have outdoor appl-ications- Since, 
in the unique case of outdoor, the rnedium and the message are identical, 
some message research devices have already been discussed in the section 
on outdoor media research. 

Since outdoor ads must capture attention and convey a message more 
quickly than m:OSt other mess m^edia, the most useful research methods may. 

" ■■ 5 

be found among the laboratory apparatus methods designed to measure visual 
responses--the tach i stoscope , ocular ^^^evices , eye-pupil camera, and so 
forth. ' 

The " simui ated f i Im trip" is one particularly ingenious instance of- 

outdoor pre-testing. In one privately conducted study, the procedure- went 

as fol]ov;s: a v/erl 1 - 1 r-cvel 1 ed highway rcute Into a city v;as fitted with 

several test posters on various billboards along the way; a movie camera 

\* . • ^ 

" was* mounted on an autom.obile v^jhich then drove the route jusj: as any incom- 

r 

ing vehicle would, anc| a film was made showing, the trip as it would be seen 
by the driver. In the test situation, respondents were .shown the film-- 
unde.r pretext of some other purposes-then questi.oned regarding v^hat- they , 
remembered about the trip. Specific questi^ons were asked regarding inter- 
esting posters along the way, brands .advertised, and so on. This method is 
adaptable for* in-hcme testing/ auditorium testing, dnd group di;Bcussion. 



CHAPTER X." POST-TESTING MESSAGES 

Post-testing has ber-n defined as checking on the performance of an 
ad or campaign after it has appeared nedia. Its primary 

purpose is tc provide hindsight on r , mance and to draw sonie . 

exclusions regarding the conduc^rjof future adve^rt i s 1 ng . As previously ■■ 
observed, post-testing results are usually a mixture of media effects and . 
message effects, and i nterpretat ion. of such data must take thi-s into 
account. 

In terms of the advertising process model, post-testing deals wi\h ^ 
advertising*exposure, percept ion, communication and occ^s iona 1 1 y wi th sales 
results. However, it most commonly deals with, the advertising exposure 

and pprcopLrun c 1-oyo:>- W.nc tli^- nti-l <oiirV> niomljcr c^poSf^d lO the ad? HCW 

much attention v/as paid to it? V/hat.was remembered from that exposure? 

The additional stages of communication and behavior can only be 
nfpncuieri indirectly through experiments to determine if exposure and per- 
ception resulted in increased brand awarfeness, improved brand attitudes, 
more brand .sales. . " 

To summarize, post-testing can be separated into two roughl«y distinct 
categories of " measurement : « 

1. Direct measurerrient of advertisement exposure and 
Iperception, usually determined by measures based 

on memory; such as recognition, aided recall, ^and 

unaided recal 1. of the advert? sement . - ^ 

■ . . -1 

2. Indirect rneasurement pf communication and behavior . 
resul t i ng f rom the advertisement., usually deter- 
mined through changes in awareness, attitudes and 
sales behavior regard! ng the product i tsel f . 

' ■ . . ■ ' \ ■ ■ •. ' . • ... • * . 
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Recognition and* Recal 1 of Print Ads -.^ 

Direct measurement of advertisement exposure \z quite similar to the 
vehicle exposure s.tudies discussed under media research; in fact, vehicle 
and advertisement exposure are usually ascertained in thr ^ame survey 
interview. Once exposgre to a vehicle has been estabi / ::h^^ , the interview 
may use recognition questii>ns or recall questions to determine ad exposure. 

j^ecogn_Ujon and the Starch Score . In studies o^ print publicat ions , 
a respondent leafs through the pages and points to the i terns he remembers 
noting or seeing, and tells an interviewer how much of it he read. The 
resultVfor a sample of persons are pbulated according to: percent who saw 
ot^ noted; percent, who read part; percent who read most or read all. .These 
are sometimes called "reader traffic scores" and are used to evaluate both 
advertising and non-advertising (cd i tor i af) . i tems . /' 

Danie-l Starch and. Company has developed a standard service for re* 
searching reader traffic scores, and every advertising man knows what is 
meant by a "Stc]rrch Score." Starch scores are basica.l.Jy the same as those 
described above, except they are reported as. "Moted^' (the percent "of pub- 
1 icat ion .readers who saw the i tem) , '"Seen/Associ ated ," the percent Who read 
,any pai^t of the ad containing the brand name; "Read Host" (the percent who 
read more than half of the ad*s written copy). ' ^ | 

The Starch service* also includes an annual summary of reader traffic 
scores called the Adnorms report. This provides average reader traffic ..^ 
iscores reported separately for each macjazlne by product class, size of a'd , 
and-use of color. An individual, ad can be evaluated by compar i ng 'i ts " 

Si 

score against the norm or average for all similar ads (same magazine's 
same size, same use of color, same product cla^) . ^ 0 ' 
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Each Starch survey consists of interviews with 200 to AOO .pet^sons-^ 

half men and half w6men--f rorri 20 or*30 areas of the United States. In 

addition to a printed report on issue readership scores, Starch prepares 

an actual copy of the inagaz i ne i ssue surveyed, with stickers on each item 

showing the "noted," "seen/assoc' and "f^ead most" scores v/ith separat«3J 

stickers for each portiofi o^ 

• ' ' -■ 

Cont r ol 1 I ng recogn i t ion errors . For many apparent reasor^s, recognition 

nieasurenients as described above are subject to reporting errors by the 
respondent. Some of the reasons for error are; aenulne confusion wit;h 
other advertisements; confusion as to v;hich magazine or which issue 
actually contained an ad; guessing; del i berate exaggerati.c^n ; eagerness, ^to 
please the I nterviev/er ; misunderstanding; interviewer errors; and so on. 

•Two methods have been devised to arrive at more reli2ble recognition 
scores; both require additional research of an extremely careful nature. 
The method of prepubl i cat i on co n trol requires tha4' a recognition survey 
of previously unpublished ads be conducted before the ads actual Iv appear 
in print; these ads may be presented In. a portfolio along with already- 
published ads, in a dummy magazine, or in an old copy of the actual maga- 
zine. These "false recogn i^t ion" scores for the unpublished ads are later 
subt racted ^^rom the scores obtained in the real - recogni t'ibn survey con-* 
.ducted after the ads are published. The confusion -control method consists^ 
of having some unpublished ads surveyed along with the real ads--u5ually 
in portfol io--and getting recognition claims as usual ; however , those 

respondents who consistently claim recogn 1 t ion of 'the false ads are later 

•i . ' ' ' ■ 

dropped from the analysis of the real ads. 

In smal Irsample laboratory studies, a couple of. other methods have 
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been used to increase the^accuracy of recognition claims.^ The tachisto- 
scoplc method is to show at high speed either complete ads or ad portions 
and require that respondents furnish further ad information before being 
certifred as readers. The screening method consists in having several 
screens over an ad, then , removi ng one at the time and getting recognition ^ 
claims at several levels \m uy. 

There are many v.. -ns Of iiieihods .for refining claioied recognitmn 

scores. Hovjever, it is doubtful that the regu I ar recogn i t ion measurement 
figurer. create any great problem cis long as the principal objective is the. 
relative evaluation of different ads in the same issue; the number of 
over-cl-aimers is not greatly d i f ferent than the under-cl a imers j overa 1 1 . 

^LL^^_ L?.?_^.U.^r^.„.^he Ga] lu^^ Those who cornel a i n-^tout 

error possibilities in the recogni tion method can get at least thebretical 

comfort from the more complicated aideJ recall procedure. Juc' . in- the 

other method , respondent s must first qualify as readers of a p cular 

issue; the basic diff rence is that the test issue is kept 'clob. ..ad the 

reader must rely almost entirely on memory for hi.s reports on readership 

of individual ads. Ga I 1 up-Rob i nson is a commercial research firniwith a 

.. ' ♦ • 

standardized service to provide such figures. , ' * 

The aid for recall comes in the form of advertisers' or brand names; 

a list of such names i ' > presented to the respondent v;ith the comment that 

some advertise*: i f :he .'ssue and some didr. t. He is then asked to specify 

which, ones he rememb'-rs from that issue, what the ad looked li'ke/ .what it 

said, and so on. Res ^rses are recorded verb^atim. The fact of recal^l is 

pot decided untiTthe interview forms are edited back in the home office.- 

The editing is a tedious and error^prone procedure wh i ch estab 1 i shes 

• o n o 
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whether or not an ad was actually seen, the mo^t memorable parts of the ad, 

arid a special, sjore called Proved Name Registration (PNR). PNR represents 

the number of Verified readers of an ad who recall some crucial element 

of the ad; this raw figure is adjusted for. ad size, color, placement in 

issue, and number of other ads in issue. The adjustment, it is claimed, 

transforms the raw score into an absolute measurement so' that ads^from 

different *issges may be^- coiup J by the same yardstick. 

Because of the contrariness of human memory, however, aided recall 

scores are general ly cons idered to be underestimates of true attent ion-^and 

* _ ■ *^ 

readership. ' 

" Comparison of ..co-nition and aired recal I scores. Since readership 
of printed ads is,"a rras been^ a subject of great interest to the adver- 
tisi^ng industry, sor, discussion should be given here to a basic methodology 
study conducted by the Advertising Research Foundation. 

Discrepancies be^tweeo recognition scores and ai|led recall scores on^ 
the same ads gave r' the PARM study'-f r i nted Ar!\)ert i s i ng Rating 

Methods. The impoi . nee of the study stemmed ' From a fundamental concept; * 
an ad cannot sell ur, i . it is read. ARF members 'voted for PARM as the 
most-needed project .!)at time, the late 50's. ngle issue of L i f > 

magazine was select ror .n intensive study of both -.ethods. One discrep- 
ancy found in. the t. r:' vds was , in the number of is^ue readers .^ The 
aided recall (Gal I up-Pobi- ' on) method results in one-third fewer readers 
of a magazine issue--!. « /ehicle expc sure*s--than the recogn i t i on (Starch) 

method. ^ . 

Another discrepancy v .-s in the characteristi.es of issue readers .- The 
recognition method-^prr -d lower proportions of persons who: are under ^JG 
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yosrs olcl, are in the middle and upper economic brackets, have college 
educations, are primary household readers, read thair magazines at home, ' 

V 

and spend only a short period of time with the issue. 

« , 

In short, the two methods picked up d i fferent numbers of issue readers 

and different kinds of readers. Since recall had^more exacting requirenents 

(f:Ot necessarily more accurate), it in effect eliminated many persons of 

certain characteristics from the audience. 

The major difference, however, was In the average ad readership scores 

obtained by the two methods. Recogni t Ion gave an average ad-noted score 

which was six times the average PNR score-- 13.'2!;^ to 3.0?;. furthermore, 

the methods produced diffei^ent kinds o.f ad readers: recall ad readers 

tended to be younger, have lower income, lower education, lower occupational 

Status. 

I7ith the passage of time betv/eeq reading and the readership interview, 
/ recall scores dropped steadily while recognition scores held steady. 

The basic conclusions of the ^PAF^ft study are that recall gives much 
lower ratings, which are much more sensitive to three important methodolog- 
ical factors-- the lapse of time before interviewing, the competence of 
^(^^interviev/ers, and the type of .sample. This results in a lack of reliability 
" or "test-retest" consistency, in recall scores. That. is', if the same ad 
. is tested twice by. a i ded reca 1 1 , different scores are more likely to be 
obtained than through' the recogn i t ion method. This. was later verified in 

another study by a major advertiser. In short, differences in aided recaTl 

' -i ^ • 

scores of different ads are more* likely to be due to* unstable research 

methods than to differences In the ads themsel ves ; therefore, recognitron 

measurement is the better techtrique. 
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Recall of Broadcast Ads 

Recognition measurement of broadcast advertisements is not feasible 
for large sdmples of persons, since it is difficult if not impossible to 
show in an interview all programs broadcast even for a single evening. 
Consequently, recognition measures are not used in broadcast post-testing, 

Telephone survey -ethods . However, the relative ease of recall 
tests of television advertising has resulted in widespread use of the 
method. The interviewing can be done quickly, usually by telephone, and 
is 'less taxing on respondent time than the corresponding magazine pro- 
cedure. ' ^■ 

A random sa^nple of telephone names Is drawn in a community. Vi^hIn 

two hours after a program' is completed , 4.e;lephone interviews are conducted 

along \^/i th following lines: 

"Did you watch tel e . i s ion tonight?" 
"Vihich programs d i/i you see?" 
"Tell me something '.bout (program seen)"* 

After being verified as a program viewer in these questioi^s, exposure 

to the commercial is determined. . 

"I7hat products do you remember having seen advert 1 sed?" 

(unaided) , . 

"Here is a^list of different kinds of products: Do you 
• remember seeing commercials for any of them?" (aided) 

"Vfhat did the commercial fell you about (name of product)?" ^ 
"l/hat brands v;ere advertised?" 

Additional questions may be asked about the bel ievabii 1 i ty, importance, 

^persuasiveness, etc., of the ^'commercial s viewed. 

/ ^: ^ _ ' ^ . 

Thrcnh this procedure, the researcher can establish commercial 
' ' ' ^ ■ • '■' " ^ . ' ' 

exposure scores expressed in percentage terms; these may be interpreted, in 

the same manner as magazine ad readership scores. i • 

- . • 2 1 1 ' ■ 
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Diary method . This \s not usuaJly considered as a recall method', 

• • ' n * 

however It qualifies technically, In the diary method previously described 

r 

under media research, the respondent may be asked to keep records of the 
conjimsj'clals seen along with program viewing, ' . 

Conclusions about Reconnltion and Recall Post-Testing 

Post-te:: t i ng base^ on recognition, oided recall and unaided recall 
are tests of what oeoole ren.'^iTiber about specific advertJ sements • 



I The recognition method appears to be super'ror to recall as a** measure 

1 of exposure and attentTon to ads'; ho^.'-iver, \t tel 1 s jnoth i ng about the 
effects of the ad; for example^ an ad can get high attention and reader- 
ship, yet have no effect on attitudes, buying, etc. 

The "recall method, aided or unaided. Is probably unrel iabl e *as a 
measure of exposure and attention; theoret t ca IJ y It is a measure of an 
ad*s effects on knowledge. However, research methodology is hot precise' 
enough to. place great reliance on the V3lidity of the results. Further- 
■{i:ore, evpn if the ir.othods wprc preciGe, there Is much evidence that factual 
recall of an ad is net at all related to the des i red ef fectST-that is, 
.:hlgh factual recall of an 'ad may be accompan 1 ed by no -chartge in attitudes 
or sales . , 

^ In short, then, the conclusion must be that recogn I t'ion sco "es a re ' 

^ ^ / 

reasonably good measures of advertising exposure an^ p^p4;qept ior/ but- 

prjbably not good measures of attitude or behavioral chan^€t- Reca II scores 

are not reliable either as mea'fiur^s of exposure and perception nor as 

measures of attitude and behavioral effects. However, both kind's of 

measures aVe widely used possibly due to their ready aval lability from 
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syndicated services, ■ reluctance to change habitual patterns, and the 
difficulty of obtaining more suil:able measures of effcct'^^ 

Atti tudes and Dehnvior Toward . i odut 

The previous sections on post-testinc] have dealt with the direct: 
measurement of attention to and rr lembrance of th;. ads themselves. The 
other major category of post- test i r deals with t - effects of the adver- 
tising on attitudes and behavior toward the prodmct advertised- 

• Research design, A consideration of research design must' enter here. 

Although prevcousiy mentioned in the section on the Research Process, some 

e.laboratibn will clarify the requirements for measuring effects of an ad 

on product attitudes and behavior. " ' ' 

One can measure attitudes toward a, product after the advertising has 

•appeared (after-only design), or both be fore'^and after the advertising 

irl^der to detect change (bef6re-and-of ter design), or before, and after 

the advertising; among both an exposed and an unexposed group (before-and- 

af ter-v;i th-control design), or after advert is i ng wi th both an exposed and 
I ■■ ■ ■ 

■'unexposed group (artcr-onlyrwith-control design). 

These, designs m^y be shown graphically as follows, with A represent-- 
ing the appearance c(f advertising, and M representing some form of measure- 
men t : • ' p 
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Af te^-onl y 

Before-and-af ter 
^ ■ 

Before-and-af ter- 
wi th"coht rol 

Exposed group 

Unexposed 
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M 



A 
A 



M 
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• Af ter-ohly~wi tar ^ 
control ' 
Exposed 
Unexposed - 



t1 



M 



Only the latter two designs'-those. usi ng a n unexposed control group- -' 
provide valid measures of advertis-inq effects. ' - ^ 

This is a very important point; it can be illustrated with the follow- 
ing fictitious e)iamp1e, in v/hich it is assumed that a campaign for -Sparkle- 
Cola -soft .drink has appeared. 



Des ign 1/ 
After-only 

Befo re-and 
after 



Percent, of respondents 
with favorable attitude 
to Sparkle- C ola - 
Before , \ After 



? (ad) 25% 



Change 
? ^ 



20$^ (ad) 



2SZ 



+5 



Before-and - 
af.ter-wi th - 
control 



EXPOSED . 20% (ad) 25% 
NOi^J-EXPOSED 15% (--) 20% 



+5: 

+5 



Interpreta tion ; Quest i^rvs^ 

25% have' the right attitude after the 
advertising. However, who knov/s if 
this is a change in atti tiide, or f 
so how much? 

A 5% favprable change in attitudes 
occurred. However, who knows if this 
was due . to the test* ad or to other 
events that occurred at the same 
time—reduction of competitive ads,, 
increased advertising of Sparkle-Cola 
in other media,, the ^^act that the ad 
appeared on a hot day and attitudes 
toward al 1 soft drinks Improved, etc.? 

Plus 5% change in exposed group; 
plus 5% in non-exposed group;' net 
change, zero. The ad had no effect 
on attitudes over and above other 
•influences, for the reasons mentl'oned 
above. . " 



Percent of respondents .. . ' 
with favorable attitude 

Design ' • to Sparklo-Co la I nterprg l^tLon ^ Questj on^ 
Before Arj:or Chanqe 

^ After-only 

^^il^^ . * A net di^fer^rice of 5'^ betwden* the 

^^SSt^ph 7 (^A\ or-/ 7 exposed and non-exposed group ?ould 

cal ly si9ni T\c^nt 

' ' ■ ■ ■ • c . • 

These fictitious data illustrate the poipt tn^t only when a non~ 
exposed contro 1 - group is measured can one be s^^e th^t any observed change 
is due to the advertising. This merely emphasii:eS ^gain the point made in 
the section pn research des i gn-^cause and effect (vvh^re an advertisement 
is the independent "dS'use" variable) can only t)e d^t:^rmined through a 
con t ro 1 1 ed exp/r i men t . There are some 'other c^nd'tfons necessary, of 
course, for^complete control--a group of respo'^dent^ 'must be randomly • / 
divided into two groups," and the advertising rn^Jst conf rol 1 abj-e so that-. 

only the test group has the opportuo-i ty for exPos^r^* F.ur.ther , / i ts valid-. 

■. . - .j".' • ^ 

ity is increased if it is a conro>Mo.d fj(^»d^xp.?rirr.^nt. 

To re-emphas!ze it s t ro n q 1 y - p c s ^ - 1 ^ s t s . c jl c^^\'y] ^^ ' ^ i- n g f e ct^i vc n e s s 
in te rms of 5tt i tud-i^ or behavior effects are r^t 'd un-less a cbntrol 
group is used. The ^rter-only or ';before-ond-a''^ter d^^s 1 gns cannot reveal 
the effects of I'-r'v'^rti sin's . ' ■ > ' 

Given that the control group condition is satisfied, however , pos t- 
test experiments of advert! s ing effect i vi.'icss ^re gt^neraHy concerned with 
measuring awareness , att jj^i^!;^ > and bchavi or in thci form of smiles inquiries 
or safes themselves. . .. . 

A;. ;a reness - One objective of advert i»s ing - U to create 'ay/arenes's of a 
n*ev^ product , or increase sallence^in the case ^f ^n established one.- 



Previous research .has shown that av^arene$'?--or "top-of-the-mind"--is 
highly related^to actual sales. Survey questions to determine awareness 
are phrased about as follows: 

^ . ''When you think of toothpaste (or other product), » 

• .'] . whith brand do you think of first?" 

^'l/hat other brands come 'to your mind?" 

This rpay seem like a naive approach, but Its simplicity is deceptive. 

Experience shbws it to be one of the most valuable survey questions for 

measuring advert i s i ng 'effects , because it is directly related to actual 

sales. , • 

Atti tu des , beliefs, buy i ng_ preference. In general usage, attitude. . 
towand a product, can mean several ttjiings"-"l ike or dislike, belief (or 
image) and buying preference. . ' ^ 

* In pcecise meaning, however, atti tude is "a favorable or unfavdrable 
feeling toward the prdduct"--the' overal 1 degree of liking or disl inking. 

The bel i ef s about a product are sometimes called its reputation or 
'!prQduct image.". Take a toothpaste brand, for example--it has several 
attrit.utes including price, taste, decay prevent i veness , and so on. It 
may rate/-hi,gh on one belief, tow on another, and just average on another. 

product/s belief ratings may or may not be related to its attitude 
rat ing-" for example, a^customer may have an unfavorable attitude toward a 
toothpaste even though the price, taste, and decay-prevention properties 



are rated^ high. Why? Because the important factor, to that customer, is 
overcoming bad breath or some other: factor. 

Buyi n g pref er ence is another kind of verbal report , somet imes. cal 1 ed 
'Tntention to buy" or "buy i ng * pred i spos i t ion . " This too can be independent 
of attitude and bel iefs ; a customer may have a favorable attitude and 
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favorable beliefs toward an advertised brand, but have no intention of 
buying it/. Why? Because he always buys groceries In a particular shop- 
ping center where his most favored brand i sn ' t carried ; rather f:han go out 
of his way, he always buys the chain. stoje brand because it's more con- 
ven ient--even though it may rate lower on brand attitude and other beliefs. 
^, Survey questions on buying preference may be^ phrased as' follows: 

i "If you were going to buy toothpaste tomorrow, 

which brand would you be most likely to buy?" 
"I7hich other brands would you consider?" 
"Are there any brands* you would definitely not 

- consider?" ' . ' . ■ 

The last question is sometimes included to determine the very impor- 

tant difference between a neutral • reaction and an actively negative one. 

instead of individual questions on btjying preference,' a buying inten- 

tion scale is sometimes used, with the respondent to check the one posi- 
^ — ' 

tlon on the scale that best expressed his intentions. Such a scai^e mighf^ 

take the following form, in the case of a particular brand of toothpaste: 

- ^ "Check the one statement that best fits your 
po^i nt of view: ' . ' 

*m de'f^initely going to buy some, right away. 
Ml }»robably buy ^some sometime, 
might buy some i n the f utu re . 

*11 probably never buy any. ' . 

wouldn't use it even if it v;ere given to me. 



Buying intention scales can be us\fu^l if carefully developed (through 
research, not from an armcha ir)^ and validated against actual usage. If 
precise, the buying intentions of a group of consumers can be plotted on 
this "ladder of preference'' and the effectiveness of advertising judged .. ^ 
by the extent to which it moves consumers up the ladder. 

... . ^ ' . u 

yf-nqui ries and sales . Another method of post-testing advertising 
effectiveness hiis already been described in the pre-testing discussion-- 
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behavioral measures such as coupon returns^or inquiries, and sales. 

c> • / . 

Inquiries are direct responses to advert i s,i'ng--ei ther. through coupons or^'^»* 
in the form of some .concact with the advertiser or his' retail outl-ets. • 
Requests for more i nforfjiat ion , requests for samples or deraonstrat ions , 
visits tO"*/etail outlets, etc., afe more forceful irtdicators of effect? 
than verbal reports.. In short, thoy are forms of action or behavior 
requiring some effort on the part of the target audience. As i'h the case 
of c^waren(ifis and the other verbal reports, one can be sure. that these are. 
direc^t effects of advertising^ only if the r.oiitroned- expcrlnient has been 

A Sales or purchases are, of course, the u1 1 imat-e-Zdes I red effect of 

advertising. One- mOst distinguish between . actual purchase and verbal 

reports of pu.rchase. A survey jquest ion' aski ng "Which tM"and do you usual ly** 

buy?*' 'or "V/hi ch brand did you purchase last?" will not give the same 

results as an actual sales measurement. Some products, such as cars and 

appliances, require that a v/arranty or registration card be filled out 

shovnng the purchaser's name at the time of sale, thus* provi d Ing an ilnob- 

trusive measure of a'ctual purchase. t\ost products, however, don't yidld 

a direct sales record identifying the. buyer, and indirect purchase measures 
f 

mus t be used . ' ^ 

' Store audits are often used to check the number of product" units that 

have been sold. In the case, of separate test markets for separate adver- 

• ' •■ ' ' ^ ' . - 

t i s i ng\ t reatments , i t ' s poss i ble" to determine advertising effects. 

Another indirect sales measure is the pantry inventory or household 

inventor'y. In visiting a sample of homes", an interviewer may ask to see 

the brands actually on hand in the household", along with the usual 
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questionnaire interview. Again, the researcher -must be able to M ink the 
possession of a particular brand of product with a controlled experiment • 
design in order to determine the effect of advertising." i 

A measure-hient of behavior— i nqu i ry . sale, store au'dit or product 
possession — is undoubted Iv a better indicator of adv ertising effect than 
a verbal repo'rt.of awareness, knowledge, attit ude or preference. Because 
of problems in gathering the data, behavioral measures a^re not^as widely 
u'loc. out in some situations, behavioral measures may be easier and 
cheaper to obtain, and they should certainly be obtained if possible. 

AnaWzing^ Post-Jest, Results to Find AdverlLsji!a_°'''"^'P^^^ 

Two major purposes of post-testing were mentioned earlier--one is to 
evaluate performance of particular ads or- carr.pai gns . the other is to 
determine some general principles that will be helpful in future advertis- 

, r 

ing. -v , .- . * " ■ 

Combined ratings and content analysis .. One way to arrive at general 
principles is to look at the content differences between ads which score 
high and those which score low on various readership measures. This 
■procedure is a combination of content analysis and post-testing measure- 
men t . - 

For example, take the case of an . advert i ser who uses magazines exten- ^ 
sively and gets'Starch readership reports on the ads. He has placed 100 
ads in a general magazine over a period of time and has readership scores 
on all of them. To look for gener ' he first separates the 

ads into three groups-25 scoring, cxtrcrr,. ; igh, 1- scoring extremely 
low/, and 50 whi ch have medi urn scores . VJhat are the apparent content 
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differences between the high-scoring ads and the ' low-scor i ng ads? A 
visual/ i nspect ion may reveal the following: 

/ . 25 ads vyith 25 ads with 



High Noted" 


Low "I Noted" 


Black-and-whi te 


2 


.12 


Two-color 


0 


o 


Four-color 


15 


5 


No i 1 lustrat ions 


• 

3 


3 


Sma 11 i 1 lustrat ion 


8 


7 


Large i 1 lustrat ion 


U 


15 


Question in headline 


13 


k 


Di rect statement 


6 


11 


No headl ine 


6 


10 



etc. 



From this analysis, he, can conclude that ad noted scores can be 
improved by using four-color and ^ using question headlines; use of an' 
i llus.trart ion apparently makes no difference. There are many other physical 
ad characteristics which can be analyzed in the same way, of course; dif- 
ferent layout techniques , dil^fe-rent persuasion strategies and so on. 

What measures are used in such an analysis? In addition to noted and 
other readership scores, high- and low-scoring ads can be compared for 
differences in attitude change, preference change, sales change— in short, 
any measure for wj;yi ch valid data are available. 

Further analysis can be conducted among different vehicles of a 
medium. For example, the high- and low-scoring ads in a man's magazine 
may differ according to headline but not according to use of color; J3 
woman^s magazine may show the opposi te. tendency; in a specialized technical 
magazine, none of the layout differe ices - - be imp-'-n-t while persuasion 
strategy may be a crucial facto- 
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only 
and 
arr i 
f ied 
t ion. 



■"h£ rjftiber of viays 
the number of : 
i nsight of th. 
at through sue; 
irbugh further us 



This combination c 

used in determining pr 

Corporation, for examp i 

analyzed them in this f 

(Schvjerin, you v;i 1 1 remer 

preference*' verbal repor' 

They have discovered sue 

in cartocn co 
than people ^ 

Commercials ^lOTnt 
(grandmothc % - 
effect i ve z- ' ' 
vi ewers . 

Humorous o 
humorous c 

Conrmercials \ 
effective th,. 



such an analysis may proceed is lir ited 
differences in high- and low-scorl g ads, 
ner doingthe analysis. The principles 

however, should be checked out and veri- 
ing and analysis, or through experimenta- 

analysis and test, scores has also been 

)f television advertising. The Schwerin 

sted thousands of TV commercials and 

J provide guidance far their clients. 

;5ed before-and-af ter changes in ''buying 

:he measure of commercial -effectiveness . j 

s as the fol lovNfing: , ^ 

s, animals are more effective 
Jin characters . 

ng a "family authority" figure 
orother, etc.) are very 
'viewers but not among young 

are less effective than non- 



..-me the competition are o:iore 
ose 'whi ch don * t . 



hany other pri nciples have been found through such analysis. It can be 
•applied to any vehicle, any medium, using any measure of advertising 
effect. * 

Content analysis of ■ compet I t i ve advert i s [nq . In order to know pre- 
cisely what the competition is doiTig, it is som(-ilniPs desirable to analyse 
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v.:i£t r:..iey're :N' collectlnr; corr^pet i 1 1 ve ads cr comme " : ia 1 s , . 

then cuiantitat - = ^na'/zinrj their cprorjcK-::. ^-in tf. -ms of • . ; per- 
s^.. ' stratei rra ^^ic5, etc. j 'rjrea' can be lear Czher 

rr- .jres are neecv. .. ov .;rse, to ceterml' ; . // effe::tive th-. cc ipir:ti t i Vc 
a;rDroaches are, du: :. :r3ption of v;hat r.'-^j say is a necess first 
st-.r which is o~ :i ner ected. 
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- Money, or advc: :i a;i;per iture, resec: ch deals v. ■ ::uestions of 

hcv/ much money to spen '^on t spend it ard v/here tc s k . 



How i^lOT To Do t 

There are many -^'-cr-'.-iM, r '] 
it'ure. H^ree conrnor .-—or 
age of sal us" and "v.3tcr . 

The "seat of tr -^'i: 
dent and the princip. c~"' 
table and they discLiss,, C;ie:; 
we spend on advertis ing acex: . 
matter'--based on their ovn 
valuepof advert i sine, rrs: 
on. Sometimes an ertiT'i r • ^ 
and the discussion v.' ' r t^- 
go to advertising, A 'un- h 
based on opinions rat* thE- 
be arrived at. This vf\ ' = 
held by th^ highest rar . inr r: 
oluble, persistent anc zr^rsv, 
will bear little or no ref?.ti 
much, in.whicn case money il. 
case extra profits will I' 
"\7atch t-^e compet/tor" 



•king wrrTP£ decisions ou citismg ev-^~id 
ocedures arc "5eat of : parts," "percer t- 
ct i tor. 

edure g ■■■^ ro'-ieth-rng P :his: the pre^i- 
jf a cor.r any it down nrc m l a Icnq cc^ .I'^encc 
nd argue the -stion. 'Hcv. much mone^-' rrould 
r?" All -I'f : r will ' av-:.: opinions or "r^e 
al intere~t5, r — judiccs or againi the 
impress people Jtside :hc company, ar::i so V 
ng budget will tr ve^ al "-3a:: / been estarb shed 
around whet proportion nf that total sn-jvuld 
t ^r days cr sorr^etlmes ironths of wrang] rrc?--ar'l 
: vi dence-^sojTie scrt of compromise solutlc- will 
eavily weightec n the d'rection of the niofn 
: ;pany officials :ak?ng r^rt and the mcs: 
: ive talke^-s at :,he tab The eventual -igure 
n to what real ;y shoul \ - spent-- it may bvt too 
[ re wasted, or it may be rto little, Jn wh^ch' 
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leading compet tors: aire (a) smarter or (b) have some divine gui :r 
(c) have some real kno'wledge based on research. The advert is .^t 
of the "watchiTig" company Is then geared to the budget of the c: oc:: zor 
in some fashion. Chances are, however, that the competitors arc • 
operating on faith and " I'gnorance. Even if the competitors' aove "t* -j J_s_ 
based on research knowledge, what's right for one company isr t • irjrily 
right for another; for example, advertising spending for a cc:-*yrj'iy i> : 
clearly leads the field in sales may be either too much or tc 'or 
companies with a smaller share of market. 

The "p ercent ag e of sales " method gives the comfortable i Chat 
it is scientific because it is based on numbers and statistic^. So'-stime 
in the dim past, a~ comtpany oracle may have. decided that* "advc: ' « iv; should 
be 3% of gross sales income." If this policy is^ followed yea - ' ■ " year, 
/it's possible to achieve a high correlation between sales anc: ac^: r — : i s i ng. 
The fallacy is that cause-and-ef f ect is rcversejil — Instead o7 ^vtr^' sinq 
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being a cause of sales, it ends up being an yeffect of sales. 

These fallacious methods are also used in determining whir media to 
use and which messages are communicated. Here, hOv/ever, we're : ncerned 
'with the mioney qJestion. 

'( 

•A Better \7a^: Control ied Fiold Experiments J[CFX) «^ 
The most accepta[::le method for determining advertising exr ndi ruiirx Is 
the controylled field experiment using sales (or profits) as tht der-^ndent 
variable. As with other advertising research methods, experts ?re -.ot in 
complete agreement on that statement; the best support for it earner rr::m 
some of the largest and most profi-table advertisers in the coun . '-y ../ho ^3ve 
adopted i.t. It satisfies the businessman's requirement for prcrricrl and 
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and PL : ; ^i: gc^ls, and the re ir cher ^ raa^'i i riement for nl ^ . 
rigoriius ~^tiE5ure'nient . 

A c:;"nDl-t::: description of crntrolle" "elc:, experirr^entr 'r -ady 

been givc in :ne chapter or "co— : adv- rt i ' ^ig research la-. >• it 

r 

may be useT-'ul this point r- ew tr -r section,) 5c-i= usvi.:. - >FX 

will be riven here fcr several p ^"-leirs of ad/ertislng ex?j^indl -„ — to tai 

advertis ng Djdcet, spending patt^^-ms t"-ie, market cor :er -- on, 
media ali3cat:on, and vehicle aVi., .ti rn. 

Setting Total Advertising Budget 

Planning a controlled field expe-iment on the tota ; ac. i? 
budget s.p.ould start many months be 'ore a new budget is to 3° 
into ef~ect. Why? Because advertising's effects are slow - :;. lale hold, 
except in special cases, antf it is desirable that advertising 3€ allowed 
to run for some time before making a final judgment. 

Hers is an example, again using the fictitious product, Star-nle-Dent 
toothpc ;te. The main dependent variable will be sales, to be .erermiined 
by store audits. (With omer products, sai'es might be der-rmied by 
sales regiistration cards, rantry inv ntv^ry or surveys or --po—c pi-r- 
chase.^ It -:ay be desira-le to aisc measure such thing? as brad a^-are-' 
ness, ^r^v;ledge, image, attitude, buv rv. p-eference, anc so or.. ' niFe a 
measure of sales alone wi : I deternint .Jhat happened, the other asu-ss 
are reeiiad t- determine wlr_ they happ -^-.d and give a betrsr umr --.andlng 
of tbts oynar-.cs of. the advortising. 

Thy; ;e;5oeri mental unit will be msr;<ets (metropol I tan s-eas) '-nsr 
than ir iividuals or small geoqraphic t-acts. The reason ni- th s i . that 
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it Is n to i r i to naripu]£.^- vera" varictiohs of iper- Jing level 

in all :::^d' a v;" chlr : narket. A v/hcle :r.n contrallzrd and varied 

jrore pr^-i ■ : el y 

Anr :hc r f.' :x c i fe is that Jt : . ^11/ ir;3035ible i" the case of 
est.:: 'Isfied ...•r::-:v to ccimpietely ^vi -^w advertisin ::;id set up 
a '*no ac. rtisi ;r:r::ro1 treatment. ::nis example, the , ntrol treat- 

ir.ent y*' i i:e the nc'""';3:i 'advertFsing bud: r. Spending 1e be varied 

above ar ::j1c the no rmal Jevel to ansi'. . *■ ":he quest ons rrjld we de- 
crease !ncre:.:e - - ad /czirt 1 s i ng budge: if so, b ' he ucr ^ " 

This -^xamp i c5.:r,^r^er. th3t/from pre-- -carr.h plcnn-r;- anc diszussion, 
management: has agreed z:. tast the fol Icwi c] expenditure le jl: c .e-half 
of no^^^.^tl (53?:^ ^ noriM,^; (iCO'i), crie-haif ^i-ove normal (150 ^ind twice 
nornai ■ 200i0 • t's ;-jc;>5sib le, cf coursr . test any other .e.v-els that 
are considered '^ractiral, aH the way tc ten timies normr; or more if 
desired. ^ 

Another e<t}unptic;n in rhls exanpie is that ac^/^rt i s 5 n-c; w iU be varied 
proport icnaxel y in media if pc..;i;"b!e.- In thu ''^^% trearme^'':* ^dt 
exampl-i:, ''^^l-^v. th- ^artl s hg Ts cu: :r ra^f, somc:'ne micnt -r \ , that • 
teBev ! Ic-r? n-.kes hid hr-f the tC" a :;v ; -^t i s 'ng budrriet and per s It v;ould 
be ea-sier :o sl-np! v :_- out tel^i^. '.^n. Th'-s proc-:::iure wo'uk , row /er," 
con'^'vse ir:ie e."-- :CtL5 cbtainc:j: : wjc .::: be impossibi e'to U ] if a-; ob- 
tair.ed c:"3n9e - , './as cue r : ^decrease" or to te evi si on 'only, 

or i^f s'Tiilar ^^c:^ ::: voulc be crtair ^ v;ith dGdrea3es in c -^r media. 
■""^^ Anpthe" -ss-Lirruti :^ in tni.s exarrpi:. s that the adverti ng me^'sages 
ther^iselves w- ' ' be hc-'^^iled ' normalty't all trtjatn[,;nts . '1, • '-^pen- ici':! 
)f'H'c/ ,\ ndvri' I ( 'LcuK^M t f 'C 1 vo^'. v-'^-fud, i: would impossible tc 
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tell w ich factor caused any cr 

r short, ir an expcrlrent 
: 'ons (rnedia used nessages..^ c :c. 
ravine made those dec 



;-.:ing alone, all c-riier condi- 

jh ...d ibe held canstanr. 
::,n-: -11^ -sumptions xw: detcJis of tne spend- 



ng experiniont can now be pi. le , wrn the fell owing inqr-^i. -it^ .poet fled 



Prdcuct (f ictrt i ous) : 
■Indeoendent variable: 
lio,. of- treatmerts : 

Prima ry ccpendert 

var i ab ; e..; 
Other depc-jdent 

var iab i .: 



Advert i si ng 

timetat^le: 
Research tiir.eta^le 



Heasurefpent 1 1 : 



to s 



At this point, as i 
up a time diac rani i - : 



Spc e-:v-int Toe thpast e 
Sdc' ing level 

Four 50'- normal, ICiC? nornai, ! 50t' normal , 
anc IC;2'^ normal ) 

Sale-- (d.:ra gat-he': ed by store ?,.jd!t£ ^ 

Awar' . ..es.: , krowleage, Irna'^e. :i.itituce, baling 
inte-^-:: ions (data grathered bv personal Inter- 
vie\- 5afTTfple survey.) 

Janu^ "y-u^cember (12 nionths) 
"-^^e::;' continuinc measuremer i for six ni^onths 
before^during, and six ;ncinths c"t:cr. 
Tiurveys: before, duni^ci ^nd aft: ' rsst. 
-r:i nrjarkets, ran'dornly divud^d rnt:.: ^oar groiups 
cf 10. - 

V r cidver-rising research projects . It is useful 

. :nanne:r: 



1 



Jan. I 



Af ter-teu:. 



Sjrveyy 



Trear-^^n-t i 


1" 




i 

{ I 2 mc i 


Period 
(6 mos . 




A (l: narKcLi; 


$-. 






100? 




B (] ' -markets: 


$: 




r -^-' ' 

1 U U . 

■ 


lOOX 




C (1 -arkets; 


$: 


1 oce 


150" 


! 00% 




D (FC markers) 


$: 


1 00/ 




If-- j 












Said-- audit 




■- Ih i 


c'^nt h '•'■-N^; 





Oec. :Mar. . une Sept.: Jan. 
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Note that morthiy sales figures be acGuniul aited, permfitti"^^ 

.detection of when the sales changes occur and how IcPrg afrter the test, 
period they persist. For the same reason, sufveys v; i 1 1 be conducicd juG.t 
before the testt, at threa-month intervals duri^rrg- rhe test, imredistely 
after and six months after. For other products, chese time intervals might 
vary, depending on /T^arkelin^g canditicns, the natural purchase cycle ard / 
other factors- - % 

From here on, there are mar' other detaiils zo pl.anned-^tne adver- 
tising agency must arra.nc^ to buv the media in "the pilanned anbunts, the 
sales auditing and surv-jy procp'kjres most be scheduiied, and nany other 
coordination efforts imust be carr feJ* ^ ut among tlic company, the. agency, 
the research firm and the mte-dia. 

During the course of the exper ?nt . rigorous aii ention muist cm: pa^id 
to detailed execution of the plan. / .-Jys is of the rhjta is car-ir::, i cut 
thioiujhotif T\\xd ;^ftpr llie experiment, esuilting :n a final repo^-^t : a 
budget decision based on the results. 

The bare bones of the amalysis,, ^wever, .ri-'e siapie. The £ in 

sales, attitudes, etc., far ;:ach trcjiment are cocnpared v/l th ea ch L-.^hi: r , ' 
and net changes compared with the control are ccyinpuvc:d. Tn outltn the 
analysis is as shown e: I r c apiers: 

Change {z-At<^r 

T're atnen L .'loc -iroi]^ - m t r.-^ hef ori:) 

— — 

A ( 50%) Defoi-'' anc artsr adverr ii i r.g A-Tount , -f- cr - • 
B (ICO^) Serrie '■ Seme 

C (ISnr^) Same Seme 

D (2002;) 3o,Tie Same 

. / ' ■ . 228 ^ • . '• 

r 
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/A:; notea refore, advertising expenditure {the independent treatment 
variab -e) can i:e varied in many ways: 

T-us: 50S, 100:^, J 501, 200% (as in the example) 

or OS, ipOS, 200^ lOGO^' 

or 752, 100%, 125'^ 
It's v.ort while to reiterate one requirement for such exper iments : 
■ y oti ner con: tions, except fhe i ndependent treat ment variab le, in the 
ti: t markets, s'-.ould be r^aintained exactly as no rmal . The money taken away 
c- added to ocvertising should not be funneled into other marketing activi- 
t ir those -arkets; local advertising by retail merchants'^ shou 1 d not be 
c: iingcu: to ccrpensate for the budget changes,' Otherwise, the results of 
tne Gx.iJeriment will be clouded. RcQc-^rding competitive advertising, there 
is of course *no way to control this; one reason fbr using 10 markets for 
each treatment is to insure that fluctuations in c^brppet i t i ve advertising 
and ot^^'^r non-controllable factors are constant for all treatments. The 
•:ime, "lace, and conditions of such testing are generally guarded as "top 
secret information,, to prevent others v/ithin and without the company from 
fouling up the results, either deliberately or accidentally. «> 

Here is a f i ct i t ioiiV/'table of results that might be obtained from the 
exonp-'«j civen: ^ 





■Sales 


1 ndex 
After 


Performance 
yr.-lonq test 


Sales Change 


Treatment 


Before 


1 mo. 


3 mo. 


6 mo. 


1 mo . ■" 3 mo . 6 mo . 


A (50t) .. 


. 100 


60 


70 


■ 80 


-'lO -30 , -20 


B ( 100'a- norma 1 ) 


100 


Too 


100 


100 


0 0 ' 0 


c (150;^) 


100 


110 


105 


100 


+10 +5 0 


Q{{2Q0%) , 


100 


160 


1 'to 


120 


+60 +kO +20 
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The researcher can draw the following conclusions from these results 
(1) changes in advertising budget' have on immediate effect which gradu- 
ally decreases as the budget is returned to normal; (2) sales are lost 
when advertising is decreased 50%; (3) sales do not increase appreciably 
when advertising is increased 50%; [h) doubling the budget produces a 
Significant increase in sales which decreases somewhat -over time but is 
maintained significantly higher as long as 6 months after the change. . 

The rate of decay in increased sales -for the doubled budget could be 
detemined by continuing tlie analysis for a year or n^ore. One could also 
trace the change in profits as wall as in sales; even though sales in- 

■ r 

creased s f gn i f i cant 1 y v/hen advertising vj^s doubled, it's conceivable that 
the cost per incremental sale was excessive, resulting in decreased 
profits along with increased sales. 

Other analyses 'could compare the sales change with changes in 
awareness, knowledge, attitudes and other dependent variables rieosured. 

Determining the Advertising Sp e nding Pattern 

This refers to the timing of advertising expenditures over time. - 
Given a certain amount of money to sp::nd over a year's period--say, one 
million dollars--an infinite number of spending patterns is possible. A 
few are shov/n beiov/: ' 
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TREATMErJT (PATTERNS) 



Rectangular : equal spend ing 
over time periods 



Spending* by Months 
123^5 6 78910111^ 



Downhi 1 1 pattern : heavy 
spending at first, gradually 
decreasing to zero 



Uphill pattern : little 
spending at first, gradually 
increasing to maximum 



V-shaped pattern : heavy 
at beginning and end of 
period, little at mid-point 




^_^'j.5§J_ 'pattern : regu 1 a r 
fluctuations based on other 
market or buying conJitions 
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There are, of course, innunerable variations in speeding pattern that 
might be teisted--j nverted-V pattiirns, W-shaped patterns,^ irregular patterns 
based or| easonal fluctuation, and. so on. The correct pattern for one 
product i: jy not be appropriate for another. Some products have seasonal 
usazje and the variations spending pattern might be geared- to those 
f luctuatitons. Other products, such as automobiles, have annual product 
changes and the advertisi^jg expenditure may be geared to introduction time. 

For tihe advertising r SKtarcher , the major point ?s this: any varia- 
tfons in spending pattern ay be tested by controlled f^eld experiments in 
much the saTne manner as buoget experirrencS . From a pool of markets, mar- 
kets can be randomly assigned to as many grouos as there are spending pat- 
tern rrreatments to be tesTcd. 

The pattern of spending can be an extrerrely important factor in the 
results obcaiined from advertising. It's conceivable that a given adver- 
tising budgett might result in 50? fewer sales or 50S more sales, depending 
on the spending patn:ern. 

Determining Market Allocation of Funds 

For one reason or ancther>-it might be desirable to test whether a 
given advertising budget gets ^J^^^er results in some kinds of markets than 
others. 

Somte of the variations in market allocation that might be considered 

are these: 

Market si ze: TREATMENTS 

Large markets (over 500,000 population) 

\ • 

Medium-sized rnarketjs (50,000-500,000) 
' vs. 

Small markets (under 50,000) 
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Market strength : TREATMEriTS 

Strong markets (where existing share of sales is 
>, high) , " 

vs. r 

Averac/e markets (sales share is medium) 
vs. ' 

I7eak markets (sales share is low) 

Geogr aphical area : JREATMEMT.5 

'Far west 

c . ^ .... 

Midwest - " 

vs. 
East 

(or, a comparison of tKe seven major census regions) 

Socio -economic . 
condi t'i'ohs :" " ' " IM^^JJ 1^1111 - 

High income (high per capita income spending) 
■ " ^ . vs . .. 

. , . Medium income . . 

vs. ' 
Low i ncome 



There are many other ways in which different geographical locr3tions, or 
markets, can vary The important market character i st ics vary from product 
to prpduct, so. no one style of market allocation is ideal for all prod- 
*ucts. r Intensive study of^other data on the product and i t^s customers pro- 
vide clues to the crucial experimental treatments. 

The controlled fielc;! experiment can test these d i fferent strategi.es 
of advertising spending by allocating the same amount of money to several 
market conditions, and measuring the resuluJ. 

He'd i a Al locati on Problems . • . 

Apart from the question of overall advertising expend i ture , one 
problem that frequently prises in advertising is: V/hich advertising 
medium, or combination of media, 'would be best for placement of additional 
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funds--rad io, TV, newspapers, outdoor, direct mail, or some combination of 
those media? 

In the chapter on medio research, this problem was discussed in terms 
of such dependent variables as circulation, audience size, and' advert i s I ng 
exposure; by such considerations, it's pos^sible to narrow down the tremen- 
dous number of alternatives to a fev; alternatives for final experimentation 
The controlled field experiment, with sales as the dependent variable, is 
really the acid test of media effectiveness. 

To test the. relative effectiveness of incremental spending in one or 
other of several media, the researcher conducts single media experiments . 
To test the relative effectiveness of combinations of media, the re- 
searcher conducts medjj_mh<^ As ,an example, assume there is 
$100,000 to invest in added medla^-that i s $1 00,000 'oV"er and above the 
normal budget. 

Treatments 

Single-media experiment : Horcnal media usage (control) ' , 

vs. 

Normal plus $100,000 radio 
vs. 

. ; ' [iormal plus $100,000 TV 

, vs. 

' . Normal oplus $100,000 newspaper 

vs . . . 

Normal plus $100^000 magazine 
. vs . 

Normal plus $100,000 direct mail 

This example contains six treatments--normal usage to serve as a con- 
trol, plus fi ve treatments consisting of $100,000 extra in" each of five 
media. It's possible, of course^ to test only one additional medium in 

r 

. this fashion, or ^s many as are. available, including outdoor , .skywr i t i ng , 

\ 
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matchbook covers, or whatever. In this case, with six treatments, the 
researchers would start with an initial sclection-of 12, l8, 2^+, 30 or 
any number of markets divisible by 9ix--the more the better--and then 
randomly divide them 1 n to" s i x - treatment groups 'as described earlier. The 
results of this experiment would p^rovide direct comparison of every 
medium with every other in terms of -sales ^and profits, and/or various 
s.urvciy measures of effectiveness. 

A rrodia mix experiment is somewhat more complica:ed, since it involves 
a simultaneous test of combination s of media at various levels. To reduce 
the ^compl exi ty , "^the example belov; will deal only v/ith two media--newspapers 
and televis ron--and two levels of addi t lonal spending in eacti.^ This 
produces four treatments'as fol lov/s: ^ 

Constant sum media mix : Treatment ■ > . 

Normal (for control) 
vs . 

' . formal plus $50,000 TV plus $50,000 ilP 

vs. , ^ ' 

Normal plus $100,000 TV 

vs. ' 

■\ ' Normalplus $100,000 Newspaper 

9 The term '-'constant sum'' above simply means that some fixed amount-- 

in this case, $lO0,0O0--is allocated among two media. To determine the 
best constant-sum combination of six media could require 6^ different 
treatments; in usual practice, owing to limitations in the number of test ' 
markets available, th.is number of . treatments would.not be feasible. 
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h. Normal plus $50i1 (Jev/spaper ^ 

Vari able sum niodia mix: r n i (m^am >■ 
■ — . 5. IJonnal plus $10011 flev/spaper. 

T - - * vs. 

— ^= 6. Normal plus $50M TV and $50M Newspaper 

1. Normal (for control) vs. 

vs. . /. Normal plus $50M TV and $100/1 Newspaper 

2. Normal plus $50M TV vs. 

vs. 8. Normal plus^$100M TV and\$50f1 Newspaper 

3. Normal pi us $100M TV vs. , 

vs. 9. Normal plus $100f1 TV and $100M Newspaper' 

In this variable-sum example, there are two media (newspaper i and 
television) at three different level s-- (zero, $50 thousand, and $100 
thousand) for each, for a total ^of nine different treatments. This is a 
variably sum media mix because, even though no single medium giets more than 
$100,000, the total spc-^ding per' t reatment varies from $50,000 to S200,000. 
The. results of such an per iment can determine not only v/hlch individual 
medium is best in compc: ison with the other, but also the effects of dif- 
ferent combinations of media. .The design shown above was actually used by 
a major advertiser not too long ago. Another company conducted an even 
more complex study in which four different media, at two levels each, .-we re 
tested--a total of 16 treatments.. Depending on' the number of test markets 
'available and suitable, an advertiser could theoretical ly test any number 
• of media, at any number of levels; in practice, 16 treatments becomes un*- - 

wieldy to. manage and is extremely expensive. 

> 'P ' ' ^ * 

Vehicle Allocation Prob lems 

-Pssuming it has already been decided to spend $100,000 in. the magazine 
medium, the next question is which vehicle to use. This would ]ead to a 
vehicle allocation study. Should the $100,000 be spent in CosTOpolJ tan , 

XX }^ ' 4 

Red book or A merican Home ? In the case of magazi-nes, the researcher could 
depart fronj the use of markets as tho ineasuiemcnt units, 'and* instead, reso'rt 
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to spirt- run experimer :n, In wh.ich individuals are the measurement 

units. In the split-n 'jchnique, a listing of individuals is randomly 

divided into treatment . .ups; this requires that sales data be keyed to 

individuals rather than narkets; this is more feasible for'some products , . 

than others. In this case, let's say that individual sales, information Is 

available (through compare orders, for example). 

Si ngle vehicle Treatment 
exper iment : 

^' . Normal spending (for control) 

vs. 

I-r-Tial plus $100,000 in Cosmopolitan ' ■ 

vs. 

• • . ^ ' "nr-:.al plus S100,0C0 in.Redrcok 
vs ' 
..orr-ral plus 5100,000 in American Home 

V The researcher c: . . also cc-^nuct const a- it sum vehicle mix and var i- 
able s um vehicle mix -:>:p-: r iment s in the same manner described previously 
for media experiments 

Other Advert i s ing Expc^' e Pro bl erns 

This chapter has ibed only a few applications of controlled 

field experiments to p o^s of total advertising budget^ soendinq pat- 
terns over time, ^oncent^t ion , media allocation and vehicle ailo- 
cation. It's alsc .os":: ble to aesinn experiments which would test" various 
combinations of those al locations . simuj taneously—for 'example, a simultan- 
eous test of total advertising budget levels and various spending patterns; 
Such complex studies are relatively easy to^deslgn, bUt they are difficult 
to execute. Several reasons for thi s d i f f i cul ty are 1 imi ted' numbers of 
suitable test markets, a high number of p^osslble treatment combinations, 
the attention o^essary for exe.cuting the details of the design, and 
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coordinat?o.n of the efforts of company, aclverti;sina agency 'and media. One 
rule of thumb is that a controlled field ..experiment becomes di fficult to 
manag^ when more than 12 treatments are • Jnvol ved . This is not to say that 
a large number of treatments is impossible, but only that^the problems 
multiply much more rapidly than; the number of treatments. 

The controlled field experiment, with sales or profir::^: n: the dependent 
variable, embodies the best business and scientific approamt-:- n adver- - 
tising research today. The plan is not suitable for ajl prc^i concern- 
ing media or messages or money--but- where possible, it is the -rie^hcd of 
choice. 

There Is a strong betief by many that statlstic*3l an-c^^ '^5I5 i t data, 
without conducting any additional or new research, can prov-'ae ar:?.>r5^r5 to 
manv advertising problems. There are equally strong beliefs by r r. 
experts that statistical analysis alone is an attempt to make "a ~\ k purse 
from a sow's ear," meaning that the statistical approach u:i£id by itself is 
purely wishful thiinki.ng. Some of those statistical technicues are discus- 
sed briefly in the next chapter. 
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CHAPTER XII. MISCELLAMZOUS TCOLl-AMDjTECHNIQUES 

. The research methods, plans, tools and techniques already described 
probably account for 35% of the time and effort being extended on adver- 
tising research. Out in front of this wave, however, ^-e the advanced. 

thinkers experimenting with other scientific approaches. 

f: r 
Just'^as in earlier examples, it's possible to understand some of 

the concepts and the applications of these tools without understanding 

all the inner workings , technica] . details and mathematical proofs. 

Sotre of these innovaticr.s 3re descri-bed very briefly below. The 

sericus advertising research - will keer touch with these "^ i^t her 

new developments by readina" fie pubHcoT. ins alreaa/ men 1 1 one c in an 

earl ier cr.apter- Some of t most : ; rt it, are the Journal of Advertismi 

h 

.Resear cn, Journal of Harketin g and JoiLTL-'i ^Ui^-Cije ^ip ^ Re sea rch . 

-' ' ' 1 ■ . 

Operations Research 

Operations research is the umbrella label given a number of. specific 
mathematical techniques that have been hel pf u i n making advertising, 
marketing and other business decisions. Computers are generally, but not 
amays, used for the complicated statistical manipulations involved. 
Included in operations research are some of the other. tools described 
below. It has been very useful in making practical decisions about inven- 
torie*s, prices, production scheduling and transportation scheduling. 



Statistical Decision Theory . - • 

Statistical decision theory isone application of operations research 
The problem to be solved is generally one of choosing betv/een two.\r more 
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alternative courses of action.. .SDT provides ostimntes of the quantitative 
"value" of tho different outcomes, and the likelihood that each will occur 
under a given set of specified conditions. For example, two alternative 
courses of action for next yearns advert! ing expenditure might be "twice 
as much as tli s year" and "half" as m^^ch as this year." Tne c ^ferent out- 
comes are measured only as '"^ncrecr^rc sales" or "decreased Sc. les." 
{ I ndepeniienr variable, advor'isinr; expenditure; dependent var able, change' 
in sales..) The bas i c qu2.stion: wrBt are the respective proL jilities 
that (a) "rr^e snles will be ob' inCv: with more advertising, \ ) more sales 
with les:. :: ^lye-- 1 i s i ng , (c) 1ei sales with more advertising, ^nd (d) less 
sales v*;i:"jn esi, advert i s i n^j? € F allows a choice between more advertising 
and less adver" sing on the bas s of the highest net value of the combined 
outcomes (more sales and less s«: es) of each. 

.■ 

Ma thema 1: ca 1 : de 1 s 




A r ::thema t i ca 1 model is an iqiatlon expressing the relationship 
between a numcer of independent variables and a dependent variable. Take 
the dependent variable, "number of sales" (X) . The things that affect 
sales >(indepe:^dent variables) might be "numfber of salesmen" (A) , "number 
of retail outlets' (B) , and 'Viuniber of advertising pages" (C)^. Then a 
5.value must be assigned to each independent variable unit. Let's say it 
is estimated that a retail outlet is 1000 times as valuable as one adver- 
tising page, and a salesman is 100 times as valuable as an advertising 
page. The eqLation might end up like this,; 

1 300A + 100B + IC = X ' : 

In short, a mathematical r^odel is a numerical expression of the factors 
that theoretically influence seme dependent variable.. 
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SImulat ion 

Simulation inv-^ves the use o" matherat I cal models to predict 
art i f IcaHy V'what^ould ha:Dpen if . . Us.ing the abeve model (with 

values or "weights" for eaich of the independent variables arrived' at thrconh 
previous experimentation), one can -i imulate a number of different situations 
and, choose the one that comes out best. For exar Die, ^ sume a company has 
an extra mi 1 Hon dol 1 ars tD spend cn marketing next year. Inruld it tfe 
spent on new salesmen, nevv retail ^sjtlets or more advert I s i np'--or some com- 
bination, of all three? Or : milli::- dollars will alTow the addition of 
ei-ther five retail outlets or 30 siiesmen or 20 advertising prages. Sales 
for each of these alternatives arc simulated beiow: 

Alternatives: Invest one , . ■ 

mi 1 1 i on dol 1 a rs in . . . Equat ion . 

Five retail outlets 1000 (S) + 100 (O) +1 (0) = 5,000 

30 sales men 1000 (O) + 100 (30) + 1 >(0) = 3,000 

20 advertising pages 1000 (O) + 1 00 (O) + I (20) - 20 

Through s ift-ulat: ion, the conclusion is dray/n that tSe extra money wculd best 

be spent on retail outlets. (The values cf the differen:: units above are 

fictitious, not based on real data, simply to Illustrate the procedure.) 

As can be noted in the above example, the crucial number for the accuracy 

of simulation is the weight or value assigned to one unit of each indepen- 

dent variable; if that isn't accurate', the equation is worthless and can be 

quite misleading. Simulation is of great val.ue for manipulat lon^of ' j 

physical objects, of .quest ionable val idi ty for determining effect's on ■ 

human thoughts and behavior. - ; ^ " 

Linear Programming . - / 

Linear programming can be illustrated as an appl i cat ion of simulatmn 
to the choice of medi^^" combinations or media mixes. For example, suppose a. 
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company has -one million dollars to spend on nin';:'::ine advertising and they 
want* to'divide it among five maga;?: I nes . The problei is, there are ! 00 
different magazines available and over 75 frinicn ciffereiit combinations 
of five magazines that might be chosen fron the list of 100. Each cbrrfSV 
nation of five magazines represents one equation — ^^thus, over 75,000,000 
eqgations must be computed. Linear programming via computer makes it 
feasible to simulate all the different "mixes" ard choose the one that will 
opparentIV maximize reach for a given amount of money. 

• Experimental Desi gn 

Various app 1 i cfet Ions ■ of experimental design already have been 
described under various *>1abels in preceding^ sections ^of the book-r 
laboratory experiments, control led field experimerts, split-run te.:.THg 
and so on. The classic experimental design involves two groups — 3 ^t--cst 
group and a contrcfl group, assignee by random izrrti on of the total prcl of 
subjects — with after-only measurement, or" before-arid-after measuram.cr " 
only the test group is exposed to the treatment variiable. 

More complex experimental designs are:.- factorial des Igns , where 
seyeraL, variations of tv;o or more independent variathles are-testcdi sji^nul- 
tanepusly; the latin-square desigr the random i zed-block design; axjd many 
others. ^ 

One crucial point to remember about experimental design is that it is 
an essential condition for .determining cause and effect.' It differs from 
simulation:' In simulation, one tries to predict what would happen in 
various situations by artificial manipulation of numbers; in experimcnta- ^ 
.t'ion, the various situations are actually tried out in the real world. 
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Needless' to -say , experimentation is many, many times more(expens i ve--but 
the value of its conclusions is also much greater. 

Factor Analys is 

Factor analysis is a statistical technique used to reduce a greit 
many vfjriables down to a fev/ general factors underlying them. 

"Image" studies provide a good example. The image of a car is com- . 
posed of many beliefs about styling, interior appearance, riding comfort, • 

durability. Initial cost, cost of operation , pickup and getaway , "t rade- i n 

^- " ■ ■ ■ ■ . . 

value, and hundreds of other product attributes op traits. ^ In trying to 

detemine which of these are most Important, it may be found that some of 
the beliefs are almost -perfect ly correlated with each other. For example, 
styling and i.nterior appearance beliefs correlate <o form an "attractive- 
ness" factor; initial cost, cost of operation and trade-in value may all 
be perfectly correlated with each other to form an ''.leconomy" factor;' dur- 
ability and pickup might go together to form a "strength" factor. 

After a factor/analysis of all the beliefs -that make up^an image, one 
may end up with only three or four beisic factors; future >age measurement 
could then concentrate on these factors" i nstead of measuring 100 diffbrent. 

bel iefs. ' ' " 

These "factors"— e.g. , attractiveness , economy,, strength--are more 
likely to be significantly related to sales-than the. numerous original ■ 
variables. 
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CHAPTER XIII. V.'MAT THE PUBLIC T^tKIKS ABOUT ADVERTISING, 

Most of this book on advertising research deal s with measuring 
advertlsiog effects for specific products, Here is quite a different kind 
of research 5tudy--one that attempted to find out what the public thought 
about advertising In general. ' . 

The members of the American Association bf Adve^rtising Agencies (AAAA) . 
had been concerned, for some time about various criticisms of advertising 
'in general. Some of the familiar criticisms are that advertising Is offen- 
sive or I rrltating, or that tliere' s. too much of ' i t , or that It raises 
product costs, and go on. 

Therefore, in 196^4 the AAAA decid-d to take a scientific approach and 
find out just what the- public really did think, instead o? relying on the 
scattered' opi'nions of a few writers and critics. The purpose was to locate, 
and understand any widespread criticism, if any, of advertising on the 
part of the public. There were two main parts to the study: one, public 
reactions to a'tivertislng as an insjl tution ; two, public reactions to adver- 
tisements themselves. • 

.The basic research procedure was a national survey of a random .sampl e 
of the "consumer population"--persons 18 and over. Two personal interviews 
were conducted with the members of the sample. In the f i rst /i nterview''^^s>^ 
standard quesiion-and-answer, procedure was followed to determine attitudes 
toward advertising as- an institution. The second part . of the data^ 
gathering process had some unusual features and will be described after 
presenting the results of the first part below. . 
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Attitudes Toward Advertising as an Institution 

. , ^ 

This part of the research was intended to ansv/er these questions: 

How important is advertising to the American public, 
in comparison with a number of other institutions? 

How favorable or unfavorable does the publ i c ^ feel 
toward advertising in general? 

, How does the public feel about certain specific 
elements of advert i s ingr-ecofiomi c aspects, social 
aspects, the content, and so on? 

Many questions were necessary to get specific answers to these ques- 
tions, but the principal results vjere as follows: 

Importance of advertising . Advertising is not a central issue in the 
day-to-day thinking of the American public. " People arc more immediately 
concerned wit'h other aspects of life such as ra i s i ng ch i 1 dren , religion, 
education and the government. 

''\ 

^ - In a list of 10 different aspects of life, 
advertising ranked last as a topic of con- 
versation; only 11^ said it was a subject 
they talked about most. 

- Advertising ranked lafit as something they 
have strong opinions 'about , wi.th only 7% 
reporting strong opinions on it. 

- Advertising ranked third among the ten insti- 
tutions as someth i ng ► tihey enjoyed complaining 
about without being too ^serious in their com- 
plaints, with 20% giyingi that, response. 

- Advertising ranked fjifth as needing immediate 
attention and change.', with 15S feeling that way. 



■ The table below summarizes th(i public's opinions on the impor;tance of . 
advertising in comparison with other aspects of life. 
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Bringing up children 
Fami ly 1 i f e 
Re 1 i g i on 

Publ 1 c educat ion 
Federal government 
Clothing and fash'ons 
Profess ional sports 
Labor unions 
Big business 
ADVERTISING 

.By any standards , advertising was not felt by the ;\me.rican publ ic to 
be a very important aspect of their lives. 

Attitudes toward advertising. Three times as many people, had favor- 
able attitudes toward advertising as had unfavorable attitudes. More 
specifically, ^\% were favorable, l4?^ unfavorable and the remaining h5% 
had mixed or indifferent attitudes. 

Those who were favorable toward advertising felt that way primarily 
because it was "informative" and "good for the business economy."' Those 
who were unfavorable felt that v/ay primarl 1 y. because it v;as "false or mis- 
lead i ng ." ."there * s too much of it," and "it Interrupts entertainment." 

A 1 1 i t udes tov/a r d; .sg^ecj f i c e 1 emen t s of advert i ^s i ng . The public was * 
discriminating about some, good a^nd bad features of advertising. On the 
one hand, most agreed tlipt advertising is essential (73/o) , that it helps 
raise our standard of J'iving (71'o), and results in better products for the 
publ i c (7^^) . On the other hand, many thought it persuades people to buy 
th'^y? they shouldn't (65%), relatively few though It results in lower 
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prices (^0%), and about half thought it doesn't present a true picture of 
the product (53S).. 

At the same tine, more than half the public believed that today's 
standards of advertising are higher than 10 years ago; said h-igher, 
lO^o said lower and the rest gave other responses. 

In summary, it is clear that the public was quite able to point out 
certain aspects of advertising v;hich are regarded highly, and others v/hich 
are criticized.- It was seen as neither black nor v;hite but, like other 
aspects of life^ as. having some good and some bad features, 

Reactions to Sp e cific Ad v ertisements 

For the second part of this study of public reaction to advertising, 
every person in the study was given a small hand counter and asked to 
click it each time he paid any attention to an ad in magazines, newspapers, 
radio or television. In addition, he'was asked. to comment in a small 

notebook on any of the ads that he found particularly good (enjoyable or 

it ^ 

informative) or particularly bad (annoying or offensive). This procedure 
led to information on how many ads v/ere consciously hoticed'by a person on 
an average day, how many of those he had some strong positive or negative 
reaction to, and other information about the kinds of ads that produced 
these • react ions . ' 

Number of ads perceived . The average person noticed about 76 ads per 
day (or at least noticed them enough to. click his counter v;hen exported). 
This represents only a small fraction of the physical opportun i t ie-s for 
exposure to ads in. the average day's intake of nev;spapers, magazines, radio 
and television. Ilo one knows exactly how many actual exposures this 

ft . .. , ^ 
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represents, but it undoubtedly runs to several hundred, and one estimate 
several years ago was 1500 advertising exposures per day per person. 
Seventy-six advertising perceptions out of 1500 exposures, if anyv/here 
near accurate, means that a person notices (perceives) only about 5% of 
cfw- oJi, phycrcdily tjiicountcred (are exposed to), or that about 35% of 
all advertisements can have no effect. 

- Women tended to perceive slightly more ads per day than men (80 to 70) 
people aged 35-^9 v/cre slightly above average in number perceived (84) and 
persons over 65 years or age perceived sonevvfhat fewer ads (62). But, in 
general, most kinds of people showed few differences in advertisement per- 
cept i on . 

Number of ads crentinq strong reaction^- Out of the 76 ads perceived 

per day, about created no strong reactions one way or the other, while 

ol^<^Ht 12 (or \G%) did evoke a positive or negative conuiient. To summarize 

up to this poi nt : 

The. average person on the average day 

. is exposed to about 1500 ads (previous estimate) 

... perce i ves about 76 of those, 

... reacts stronql y to about 12 of those, of which about 

Ii.6 are favorable reactions and 3-^^ are unfavorable 
* react ions . 

What are the characteristics of that small proportion of ads which 
^ evoked strong reactions either positive or negative? 

Among the "strong reaction" responses, 23^ v-jere annoying, 5% v/ere 
offensive, 36% were informative and 36^ were enjdyable. That is, when 
there is any conscious reaction to an ad at all, it Is more than tv/Ice as 
likely to be favorable as unfavorable. ^' 

, 248 



2hrS * 

However, as night be suspected, cartcsin kinds of advertisements are 
more likely to be annoying or* offensive than others. 

Out of 78 product categories mentioned, five received predominantly 

negative reactions. Against the average 5?! "of fens i veness Index'* for all 

J 

ads, liquor ads scored S5Z and cigarets scored I9g. 

Either because of the nature, of the^roduct; or the nature of the 
advertising, those product-groups were more annoying or offensive than 
others. 

Surrima ry 

This AAAA study went on to show wny certain ads were seen as informa- 

tive, enjoyable, annoying and offensive, and such research data might be 

useful in making advertising more palatable to the public. The general 

concl us ion% were as follows: 

(1) Aclvertising is not seen by most of the public as being a 

topic of great concern compared v/ith other aspects of daily 
life. 

- (2) More people have favorable than unfavorable attitudes toward 
advertising in general. > 

(3) There are nO great differences ai"ong different kinds of people 
in their reaction to advertising. 

(^) People consciously notice only s very small proportion of 
the ads to which they're exposed. 

(5) A substantial majority of the ads noticed don't stimulate any 
str g feelings, either positive or negative, 

(6) Among that sm^n proportion of ads which do evoke a strong 
reaction, the favorable reactions outnumber the negat i ve ones . 

(7) Sdme kinds of products are n^ore likely to get negative responses 
than others- 

This broad look at public attitudes toward advertising in general may 
be useful in helping research, do a better j^b for advertising. 
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